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Editors’ Introduction 


Anthony L. Ambrosio 
Guest Editor 
Emporia State University 


& Douglas J. Simpson 
Editor 


Texas Tech University 


This issue of the Journal of Thought addresses a number of signifi- 
cant issues central to multicultural/diversity (MCD) learning outcome 
assessment and assessment plans in teacher education. Among the 
issues addressed by the contributing authors are the ethical use of 
assessments and the impact of desegregation trends on assessment 
systems. In addition, attention is focused on questions regarding measur- 
ing knowledge bases, implementing web-based surveys across programs, 
promoting equity and accountability through standards-based instruc- 
tion, employing strategies for critically analyzing home/school/teacher/ 
student cultures, and measuring faculty (rather than student) knowl- 
edge, skills, and dispositions. Another aim of this issue of the Journal of 
Thought is to examine some of the efforts, results, and cautions of those 
who are employing MCD assessment plans at their institutions. 

We may be prompted to ask, why is measuring MCD learning 
outcomes important? Answers to this question will no doubt vary at 
times, but we see several reasons. The first reason is that there is a need 
to address more completely and intelligently professional interests and 
accreditation mandates. National education organizations, such as the 
American Association of Colleges for Teacher Education (AACTE) and the 
National Council for Accreditation of Teacher Education (NCATE), have 
developed position statements and/or accreditation standards in the area 
of MCD education. A second more cogent reason for being interested is 
the rapidly changing diversity in the public classroom versus the less 
significant diversity of students in teacher preparation programs. The 
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2000 Census Bureau figures indicate that 33% of children are ofa racial or 
ethnic background other than non-Hispanic white, a number that will, by 
some estimates, increase to nearly 50% by 2020. Contrast this percentage 
and trend with the fact that currently 86.5% of teachers are white and 75% 
are female, according to Gollnick and Chinn (cited in Huber-Warring & 
Warring). In addition, as G. Pritchy Smith states, “the typical white 
preservice teacher candidate will have attended public schools where 80% 
of the students were white and where exposure to students of other ethnic 
groups will have been minimal.” In his article in this issue, Smith says, “If 
the process of educating primarily monocultural teachers is likely to 
become more complex, designing assessment systems that humanely and 
authentically track and assess the developmental progress of teacher 
candidates is likely also to become more challenging.” 

Since many educator preparation programs in universities and 
colleges have little control over their demographics and no influence on 
their candidate experiences prior to admission, it is paramount that they 
determine whether or not they are producing teachers who can function 
effectively in a professional setting. As Tonya Huber-Warring and 
Douglas F. Warring point out in their article, “The responsibility of 
schools and colleges of education becomes that of determining not only 
what to teach to accomplish the development of these multicultural and 
global perspectives and knowledge bases, but how to assess the under- 
standing of candidates regarding diversity, multicultural, and global 
perspectives.” However, some researchers, like Smith, believe that there 
are few teacher education programs that are effectively meeting the vital 
need of preparing individuals for life in a multicultural society. Many 
studies have shown that preservice teachers not trained in MCD educa- 
tion have low expectations for minority students. Furthermore, many 
multicultural students learn differently than most students from the 
majority culture, and they are frequently at-risk of misidentification, 
misassessment, miscategorization, and misinstruction. If preservice 
teachers are not trained to be sensitive in meeting the needs of all 
learners, cultural misunderstandings could result between the teacher 
and learner. Worse still, many students will be less well educated than 
they could have been if teachers had the appropriate understandings, 
dispositions, and skills needed to teach multicultural children and youth. 
Many, perhaps most, teacher education programs, therefore, must seek 
out additional students to prepare prospective teachers to work success- 
fully in multicultural and diverse environments. 

Although colleges of education nationwide have improved their 
assessment plans over the past decade, largely due to professional and 
accreditation expectations and requirements, many are still struggling 
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with measuring meaningful MCD outcomes. The problem of producing 
culturally competent educators is exacerbated by the lack of tools to 
evaluate how well prepared our students are to function professionally in 
diverse settings. An extensive review of the literature and frequent 
attendance at national professional meetings in teacher education and 
multicultural education indicate that this is an area where little sus- 
tained and systematic research has been attempted and few assessments 
exist beyond attitude scales. Many teacher education programs still have 
not sufficiently delineated the expected outcomes for multicultural 
education in the area of knowledge, dispositions, and performances. 
Programs often contain vague goals such as “we will prepare our students 
to work in diverse and multicultural settings.” Only recently have 
institutions attempted to employ MCD specific assessments to measure 
student attainment of expected outcomes for an entire program. In this 
issue of the journal, we seek to address these and related concerns. 

The initial article by Smith, “Speaking out on Assessment of 
Multicultural Competencies and Outcomes: Some Cautions,” represents 
the keynote address he made at the 2nd National Conference on 
Assessment of Multicultural/Diversity Outcomes. Smith explores the 
changing demographic trends caused by desegregation in the public 
schools and their effect on assessing cultural competence. He also 
examines important issues of fairness, justice, and equity in assessment. 
His points on creating assessment systems that are internal and humane 
are timely in light of the high-stakes testing required in both P-12 and 
higher education. His words remind us that assessment is for growth and 
potential, not failure and punishment. 

The next article by Huber-Warring, Linda Mitchell, Mara Alagic, and 
Ian Gibson, “Multicultural/Diversity Outcomes: Assessing Students’ 
Knowledge Bases Across Programs in one College of Education,” incor- 
porates Smith’s knowledge bases into web-based MCD surveys used 
across programs in education. These authors directly connect theory and 
practice using assessments and employ a research design tied to program 
improvement. They illustrate the use of a broad array of assessments in 
an evaluation plan while still pinpointing the effects of specific educa- 
tional experiences (e.g., a course). 

Donna E. McKibbens is the author of the next article, “Promoting 
Equity and Accountability in Multicultural Classrooms: Pre-Service 
Teachers Use Student Work to Evaluate the Impact of Standards-Based 
Instruction on Student Learning,” that examines efforts ofher institution’s 
College of Education to promote equity and accountability through 
standards-based instruction. This article illustrates the practice of “clos- 
ing the loop” by describing program and course changes faculty have 
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completed based on assessment data. She also takes closing the loop to 
the next step by asking for evidence of actual learning impact produced 
by teacher education candidates. Her research finds that learning gain or 
impact indicators were estimated indirectly or not at all. She concludes 
“most of the evidence as currently collected would not provide adequate 
data for the new performance assessment standards.” She reminds us 
that we need to go beyond evaluating lesson plans and the collection of 
student work to examining direct learning impact. Indeed, performance 
indicators should also be learning outcome indicators. 

Furthering Smith’s idea of humane testing, Huber-Warring and 
Warring call for the pursuit of equity, justice, and human rights in the 
teaching and learning process in their article “Assessing Culturally 
Responsible Pedagogy in Student Work: Reflections, Rubrics, and Writ- 
ing.” They employ a “whose culture” field-based cultural awareness 
experience to target multiple MCD learning outcomes, and assert that 
culturally responsible pedagogy requires deeper levels of reflection and 
awareness that can be found in qualitative immersion techniques. Their 
use of a reflective piece ties the respondent’s practice to her or his own 
selfidentity. 

The idea of the importance of experiential opportunities and assess- 
ments is expounded in Mitchell’s article, “Impacting Teacher Candidates’ 
Knowledge, Skills, and Dispositions Regarding Diversity: Faculty Trig- 
gers.” Her article provides results of an assessment of faculty on what has 
affected their MCD knowledge and practice with respect to their role as 
teacher educators. In the search for sound performance assessments, it 
is gratifying to know that we can turn our real-life experiences into 
assessments strategies and use a more reflective structure in evaluating 
our own lived experiences and our students’ lived and field experiences. 

Finally, Warring’s article “Assessing Student Multicultural Atti- 
tudes, Knowledge, and Skills in Teacher Education” examines the use of 
assessments to evaluate a specific course experience. Along with the 
other articles, it rounds out the use of assessment for both programmatic 
and individual course evaluation. 

In conclusion, it appears that building an assessment plan requires 
at least the following: (1) identifying partnerships across programs, (2) 
operationalizing learning outcomes and aligning them with accreditation 
needs, and (3) adapting/adopting/creating assessments and a plan for 
using the data for individual growth and program improvement at the 
student and faculty levels. The articles in this issue, together, address 
each of these significant building blocks. As you read them, we hope that 
they will stimulate reflection, dialogue, and action—including more 
research—in this increasingly important arena. 
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Speaking Out on Assessment 
of Multicultural Competencies 


and Outcomes: 
Some Cautions' 


G. Pritchy Smith 
University of North Florida 


I am honored to have been invited to give the keynote address at this 
National Conference on Assessment of Multicultural and Diversity 
Outcomes. I want to thank Anthony Ambrosio of Emporia State Univer- 
sity for this opportunity to share some of my thinking about assessment 
of multicultural competencies in teacher education programs. I have 
titled this address “Speaking Out on Assessment of Multicultural Compe- 
tencies and Outcomes: Some Cautions.” Let me be clear and upfront 
about what I am going to talk about. I am going to ask you to think along 
with me on three topics. The first topic focuses on the challenges of 
assessing multicultural competencies in an era of high-stakes testing. 
The second topic centers on concerns I have regarding the direction some 
College of Education assessment systems are taking. And the third topic 
concerns predictions about the next generation of teacher candidates’ 
dispositions toward diversity and their knowledge about diversity. Let me 
turn to the first topic. 


Assessment of Multicultural Competencies 
in an Era of High-Stakes Testing 


In order to address the topic, Assessing Multicultural Competencies 
in an Era of High-Stakes Testing, we need first to ask ourselves the 
question: Why are we multicultural teacher educators even trying to 
develop assessment and evaluation systems? The answer to this question 
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is far more complicated than it might appear at first glance. The simple 
answer is that we multicultural teacher educators really do need a 
humane evaluation system. It should consist of multiple types of assess- 
ment methods, in order to make humane, data-driven decisions about the 
actual effectiveness of our teacher education programs in preparing 
preservice teachers to be proficient teachers of culturally and linguisti- 
cally diverse students. This reason for our development of assessment 
systems is authentic and, in my mind, legitimate, and therefore, validates 
our purposes for being at this conference. A second reason we multicultural 
teacher educators are trying to develop assessment systems, I suspect, 
isthe revised NCATE standards, particularly Standard 2 (the Assessment 
Standard) and Standard 4 (the Diversity Standard). In tandem, Standard 
2 and Standard 4 mandate the development of an assessment system if 
we want to attain and maintain national accreditation and, of course, if 
we want to fulfill our professional responsibility of assuring that “[our] 
programs and graduates are of highest quality” (National Council, 2001, 
p. 23). This second reason, it seems to me, is also legitimate and validates 
our purposes for attending this conference. 

However, a good many of us attending this conference, I suspect, are 
beginning to question, as Iam, what is going on in the field of assessment. 
Notice that I have stressed the need for humane assessment to distin- 
guish our work from a type of assessment sweeping the country that 
appears to me to be a rather vicious and ruthless type of assessment that 
appears to be more arbitrary and punitive than one that provides 
formative and diagnostic information regarding the developmental growth 
of our teacher candidates. After all, we are living in an era in which 
neoconservatives have paralleled the term assessment with the term 
accountability in an inhumane process and system that looks an awful lot 
like Jim Crow educational policy that will ultimately militate against the 
very children it purports to help. There are valid reasons for Joel Spring 
to call the No Child Left Behind (NCLB) Act the “No White Middle Class 
Child Left Behind Act” as he did in a keynote address at the 2002 NAME 
conference in Washington, D.C. Other critics have called the NCLB Act 
the “No White Child Who Speaks English Left Behind Act” and the “Leave 
No Child Untested Act.” And more recently, critics have suggested the 
NCLB Act really ought to be called the “No Money Left Behind Act.” 

I expect that a good many of you in the audience have been in a state 
of confusion, as I have, over the value of the NCLB. Indeed, NCLB is a 
mixture of positive and negative policies and promises. On the one hand, 
there are number of aspects of NCLB that most multicultural teacher 
educators cannot help but applaud: 
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1. For example, we cannot help but applaud NCLB for its symbolic 
concern for children of color, poor children, children in rural and 
urban schools, children who speak languages other than English, 
and special education students—children who too often histori- 
cally have been neglected in the educational system. Specifically, 
the language of the act itself refers to “high-poverty, high- 
minority and low-achieving schools.” In truth, the assessment 
and accountability system means that local districts and states 
can no longer hide inequities, particularly funding inequities. 
The data enable us to see right down to the individual school 
classroom. A particular school can no longer hide the under- 
funding of the education of children of color, children who speak 
languages other than English, poor children, or of special educa- 
tion children. Indeed the data base generated by NCLB can take 
us right down to finding and exposing inequitable funding across 
a state between school districts, within a school district, or 
between classrooms in a particular school. When we remember 
the Herculean effort that was required by plaintiffs filing suits 
against inequitable funding to collect the data to prove their case 
before the existence of NCLB, we cannot help but applaud this 
aspect of NCLB. The data are right there now, ready for use in 
litigation. Some state legislators, governors, state education 


officials, and local school superintendents and boards are running 
scared right now because of the implications for litigation of 
having ready-made state collected data bases that can document 
funding inequities. 


2. Second, in addition to exposing funding inequities, the assess- 
ment and accountability system of NCLB also provides data that 
expose the educational and academic neglect of children of color, 
poor children, children in high-poverty rural and inner city 
schools, children who speak languages other than English, and 
special education children. Because the data in the annual yearly 
progress report inust be disaggregated by ethnic group, non- 
native speaking categories and special education categories, not 
even suburban schools can escape the exposure of their educa- 
tional neglect of children who have been ignored too often. Thus, 
it seems to me that multicultural teacher educators cannot help 
but applaud this aspect of the NCLB either. 


3.Third, most multicultural teacher educators cannot help but 
applaud the NCLB’s mandate that every classroom must have a 
“fully certified” teacher in the “core subjects” by 2005-2006 and, 
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of course, the mandate that all newly hired teachers in schools 
receiving Title I monies had to be fully certified by the 2002-2003 
school year. As Education Week’s Quality Counts 2003 Report 
noted, 34% of teachers in high-poverty, high-minority and low- 
achieving schools were either on emergency permits or they 
were teachers who were not fully qualified in the subjects they 
were teaching. 


Whereas these three policy mandates are illustrative of some of the 
positive aspects of the NCLB Act and its evaluation and accountability 
system, there is much in the NCLB Act and its evaluation and account- 
ability system that is wreaking havoc. In one sense, the NCLB Act has left 
teachers and students, particularly in low achieving schools, to borrow a 
phrase from Howard Good (2004), “doomed to sizzle like sausages in the 
flames of some educational hell” (p. 58). What multicultural teacher 
educators cannot abide in the NCLB Act is that its evaluation and 
accountability system is arbitrary, autocratic, authoritarian, coercive, 
and inhumane, particularly inhumane to students, teachers and princi- 
pals. And we cannot abide in the evaluation and accountability system the 
use of shame to coerce children and teachers to achieve at higher levels. 
Larry Cuban (2004) hit the nail on the head when he wrote “that shame— 
naming failing schools—has become the federal weapon of choice to 
coerce higher performance from students, teachers, and principals” (p. 
58). Like all conservative reform initiatives that I have observed over the 
last 43 years of my career in education, the NCLB evaluation and 
accountability system is a high-stakes testing program that creates 
winners and losers. And we are not surprised that once again the winners 
are largely white middle class students of privilege and the losers are 
primarily children of color, poor children, children who speak languages 
other than English, and children with learning disabilities—all of whom 
are the very target groups that the original bill was purported to help. 

In truth, from colonial times to the present, any astute observer of 
the day could predict with unerring accuracy who would be the winners 
and losers of any conservative policy initiative. It’s as simple as that. 
What is happening in Florida to school children and teachers is happening 
in most states. In Florida, 53,000 3" graders failed the FCAT and were 
retained last year, and 12,000 seniors failed the test and did not receive 
their high school diplomas. In Florida, at each testing point a large 
number of students are being retained and backlogged in the system, and 
no one seems to know what to do about it. The vast majority of failing 
students, of course, attend high-minority, high-poverty, low-achieving 
schools. After two years of attending an F school, a student is supposed 
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to have the right to transfer to a passing school. Of course, there aren’t 
enough A, B, or even C schools to accommodate all the students in F 
schools. And when children of color from the F school show up at the doors 
ofthe suburban A schools, vouchers in hand, they are told “We don’t want 
you here. There is no room.” Friends, shame is the outcome of high- 
stakes assessment; and I, personally, do not want to be associated with 
such a system. And I expect that many of you who are attending this 
conference on assessment do not want to be associated with it either. 

Therein lies one of the most important points I want to make: As we 
develop assessment systems to comply with NCATE Standards 2 and 4, 
we must be very cautious and careful not to create a system of high-stakes 
tests and other forms of assessment that simply replicate the worst 
aspects of the history of measurement and evaluation in this country, 
that, like the NCLB evaluation and accountability system, do little more 
that create predictable winners and losers. To be more specific, we cannot 
allow our assessment systems in Colleges of Education, designed to 
comply with NCATE Standards 2 and 4, to become arbitrary and punitive 
processes that confer shame on our teacher candidates. And, we must be 
very careful not to create assessment systems and make decisions that 
disproportionally prevent African American, Hispanic, Asian American, 
Native American, and other candidates of color from being successful in 
our teacher education programs. 


Concerns Regarding Colleges of Education 
Assessment Systems 


Perhaps, this warning is coming too late. I have several concerns with 
some of the assessment systems being developed by Colleges of Education 
in order to comply with NCATE Standard 2, particularly with that part of 
Standard 2 that centers upon candidate qualifications and candidate 
performance at the point of admission, at key transition points in the 
program, and at the point of program completion. In some Colleges of 
Education, I fear that these transition points are becoming not gateways 
but instead gatekeepers that prevent candidates (particularly minority 
candidates) from moving forward. This arbitrary practice flies in the face 
of everything we know about the developmental nature of learning and 
about the developmental process of becoming a career professional. And 
this arbitrary practice also contradicts everything we know about the 
developmental nature of the processes of developing multicultural 
competence and becoming a multicultural person. 

In particular, I have several problems with the way teacher education 
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assessment systems appear to be evolving. Let me emphasize just three 
of these problems. The first problem I have is that, as our Colleges of 
Education develop assessment systems in order to maintain both state 
department of education accreditation and/or NCATE accreditation, we 
are coerced, whether we like it or not, to mix inhumane, external, state- 
mandated, high-stakes teacher tests—both at the admission point and at 
the program completion point—with more humane internally designed 
assessments. In fact, NCATE Standard 2 calls for use of “multiple 
assessments, from internal and external sources” (National Council, p. 
22). The “assessments from external sources” in every College of 
Education assessment system I have examined are really state-mandated 
tests such as the SAT, ACT, PPST, Praxis I and II, the GRE, or some 
similar state-customized standardized test. And despite the NCATE 
admonition that “Fairness, consistency, accuracy, and avoidance of bias 
in the assessment system must be considered” (National Council, p. 23), 
and that “in particular, attention must be paid to the potential impact of 
the assessments on a diverse pool of teacher candidates” (p. 23), the truth 
is that every one of these tests has a disproportionate elimination effect 
on candidates of color. 

It seems that we have learned little from the past or from the 
extensive body of research that shows that the distinguished fields of 
measurement and evaluation and psychometry have never been able to 
develop even one test that I know ofthat does not have a disproportionate 
impact on most minority groups. Passing rates and score data indicate 
that on every one of the admission and certification tests being used 
across the country (including the SAT, ACT, PPST Praxis I, Praxis II and 
other state customized tests) African American, Hispanic, Asian Ameri- 
can and Native American candidates score disproportionately lower than 
white candidates and are, therefore, all disproportionately eliminated 
from the teaching profession. 

Whereas the development of and use of internally designed alterna- 
tive assessment techniques, sometimes quantitative and sometimes 
qualitative, are laudable, we are finding that they are often not respected 
and do not count if a candidate does not pass the state-mandated 
standardized tests. Outside the profession, qualitative assessments such 
as those related to portfolios, vignette response analysis, and analysis of 
autobiographical and journal narratives are respected least ofall, particu- 
larly in the current political environment where the conservative 
preference is for quantitative scientific-based practice and assessment. 
Qualitative assessments may indeed help teacher educators monitor and 
document growth of teacher candidates, and qualitative assessments 
may help teacher education programs comply with NCATE standards; 
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but the only assessments that matter for determining who will and will 
not teach seem to be the high-stakes, state-mandated teacher tests. 

The second problem I have is the use of high-stakes state-mandated 
standardized teacher tests that do not have established predictive 
validity, despite admonitions against their use in the APA Standards for 
Educational and Psychological Testing and from the commercial test 
development companies themselves. Attempts to establish predictive 
validity of teacher tests by correlating test scores to classroom teaching 
performance have proven to be futile. With typical correlations of 0.30 
and below, only about 10% of the variability of teachers’ classroom 
performance can be explained by standardized test scores, with 90% of the 
variability being due to factors not measured by the standardized test. For 
over a decade, this shortcoming has been widely known and discussed, as 
seen in the words of Murray (1986): 


The percentage of the variability in teachers’ performance that can be 
attributed to their performance on any standardized test of intellectual 
or academic accomplishment is so low (about 10 percent at best) as to 
make it nearly ridiculous to give performance on these tests a central 
place in the decision about who should teach or be retained as a teacher. 
It has proved impossible, with our existing measurement techniques, to 
establish any meaningful connection between standardized test scores— 
or even school grades—and later performance in any of the professions, 
including teaching. 

There are good reasons for this lack of a strong connection and thus 
noresponsible investigator advocates giving these scores a central place 
in any decision about the potential of a prospective teacher. Used as 
supplemental information, test scores confer a marginal increase in the 
accuracy of prediction about eventual teaching proficiency; but no com- 
petent psychometrician would supplant this other information. 

The rule, confirmed repeatedly, is that the best predictor of perfor- 
mance in a situation is the most recent past performance in that 
situation or a similar situation. Thus, high school grades, not SAT scores, 
are the best predictor of college grades; the best predictor of teaching 
performance is past teaching performance, and no other factor or com- 
bination of factors will yield a better prediction. Often that is why 
performance in the student teaching course, as limited as it is, is a 
predictor, however weak, of later teaching success. (p. 25) 


A third problem I have is the use of high-stakes, state-mandated 
standardized “teacher tests” that do not measure anything important 
about teacher candidates’ knowledge, dispositions and skills for teaching 
culturally and linguistically diverse students. Despite claims that the 
tests assess matters related to teaching al/ students, true multicultural 
content in the exams, if it exists at all, is weak. 
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Let me conclude my remarks regarding the first topic of my presen- 
tation with this important point: Any College of Education that uses the 
high-stakes, state-mandated, standardized admission and certification 
tests as part of its Assessment and Accountability System must face the 
truth. The first truth it must face is that its Evaluation and Accountability 
System is a primary contributor to reducing diversity in the candidate 
pool and, therefore, works against that aspect of Standard 4 that states 
that “Candidates interact and work with [other] candidates with 
exceptionalities and [candidates who are] from diverse ethnic, racial, 
gender, language, socioeconomic, and religious groups in professional 
education courses on campus....” (National Council, p. 30). The second 
truth Colleges of Education must face is that, like with the NCLB Act, its 
own Assessment System confers shame on the eliminated university 
students. Ifanyone in the audience does not believe shame is the major by- 
product, I challenge you to convene a focus group of African American, 
Latino, and other candidates who failed the teacher tests at your institu- 
tion. If any one accepts this challenge, let me warn you that at the end of 
the focus group after you have listened to the students’ testimonies, be 
prepared to hang your own head in shame. Let me share the testimony of 
one female African American student from such a focus group: 


I always thought I would be a teacher like my mother. Since Middle 
School I have volunteered in my mother’s classrooms and the classrooms 
of other teachers. I really loved helping the children. Now, I know I will 
never bea teacher. I have failed the CLAST exam three times. You know, 
it never occurred to me that I was not smart enough to bea teacher. Ihave 
cried a lot about what all this means. And, you know, Iam embarrassed 
about failing the CLAST-like I said, three times now. I am ashamed. I 
can hardly face my mother. I don’t tell anyone else though. It’s time to 
move on. I’m an English major now. I had to change my major from 
education to English my junior year. 
—Testimony, Lessie Jackson, 
African American student (name changed) 
Focus Group, October 16, 2002 


As I said before, I do not want to be associated with this kind of 
assessment system, and I suspect many of you do not want to be 
associated with it either. I probably know too much. I know that no 
existing standardized teacher admission or certification test has scientifi- 
cally established predictive validity. I know that too many candidates who 
pass the tests become mediocre or poor teachers and that too many who 
fail the tests might have become good or even great teachers. Knowing 
that the present state-mandated assessment and accountability systems 
are artificial and hypocritical, I, as a professional teacher educator, resent 
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being coerced into becoming a party to systems that create winners and 
losers, confer shame on the losers, but still do not tell me who will or will 
not be competent teachers of culturally and linguistically diverse school 
students. Personally, I have grown weary of trying to justify the 
unjustifiable. Even worse, I have grown weary of being coerced into 
justifying injustice. Let me turn to the third topic of my address. 


The Next Generation of Teacher Education Candidates’ 
Dispositions, Knowledge about Other Cultures, 
and Skills in Relating to and Teaching Diverse P-12 Pupils 


Teacher educators who are developing and refining humane assess- 
ment systems that will authentically measure teacher candidates’ dispo- 
sitions and knowledge regarding social, racial, cultural, and linguistic 
diversity must consider the impact of school desegregation trends. Thus, 
one of the most important topics to provide a context for the work we have 
come to this conference to accomplish is that of the dispositions toward 
diversity and experiences with diversity that will likely characterize the 
next generation of teacher education candidates, as predicted from the 
two most recent reports from Gary Orfield and his colleagues at the 
Harvard Civil Rights Project. My main thesis is that what happens in P- 
12 education regarding opportunities or lack of opportunities for expo- 
sure to racial, cultural, and linguistic diversity during one decade affects 
the preparation of teachers in the next decade. Recent trends of increas- 
ing segregation and resegregation in the public schools have profound 
implications for multicultural teacher education programs and the 
preparation of the next generation of teachers. That said, I will be 
stressing the answers to two questions: (1) What are the current patterns 
of desegregation, segregation, and resegregation? (2) What are the 
implications of these trends for teacher education? Let me turn to the 
first question: What are the current patterns of desegregation, segrega- 
tion and resegregation? 


Patterns of Desegregation, Segregation, and Resegregation 


My guess is that most of you in the audience work with teacher 
educators and other colleagues who are completely oblivious to the actual 
facts regarding the status of desegregation in the U.S. Let me say that 
educators and particularly faculty members in multicultural teacher 
education programs owe a great debt of gratitude to Orfield and his 
colleagues at the Harvard Civil Rights Project for their persistent 
determination over the last decade to collect and analyze data regarding 
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trends in desegregation and resegregation in the United States. Indeed, 
without the studies issued from the Harvard Civil Rights Project there 
would be almost no systematic research-based effort to educate the public 
about the present status of desegregation. In fact, this topic of my address, 
which has as its main purpose to draw implications for the preparation of 
the next generation of teachers, draws heavily upon the findings from two 
recent studies from the Harvard Civil Rights Project: Frankenberg, Lee, 
and Orfield’s A Multicultural Society with Segregated Schools: Are We 
Loosing the Dream (2003) and Orfield and Lee’s Brown at 50: King’s 
Dream or Plessy’s Nightmare (2004)?? Although these two studies docu- 
ment many trends that portray a complex profile regarding desegrega- 
tion, segregation, and resegregation across a nation of large and mid- 
sized urban, suburban, rural and small town schools, several trends have 
particular relevance for making predictions about educating the next 
generation of teachers. 

The current status of desegregation in the nation’s schools is bleak. 
Despite considerable gains made toward desegregating the nation’s 
schools during the 1970s and 1980s, currently “U.S. schools are becoming 
more segregated in all regions for both African American and Latino 
students” (Orfield & Lee, 2004, p. 1). Based on the Common Core Data of 
the National Center for Education Statistics of the U.S. Department of 
Education, the recent studies by Orfield and his colleagues clearly show 
that schools in the Northern states are presently more segregated than 
in the Southern states, and the Southern states are more segregated than 
they were in 1988. In fact, for almost three decades the South has been 
the most racially integrated region of the country despite accelerated 
resegregation since 1988 (Orfield & Lee, 2004). 

Twonew trends are particularly relevant to understanding the current 
status of desegregation at the national level. First, a discouraging recent 
trend is segregation in the suburbs. The nature of this new pattern of 
segregation is described by Frankenberg, Lee, and Orfield (2003) as follows: 


In 1967 the nation’s largest suburban systems were virtually all white. 
Despite a huge increase in minority students in suburban school dis- 
tricts, serious patterns of segregation have emerged in some sections of 
suburbia as this transition takes place. Many of the most rapidly 
resegregating school systems since the mid-1980s are suburban. Clearly, 
segregation and desegregation are no longer merely urban concerns but 
wider metropolitan issues. (p. 5) 


A second, more positive, trend is an increasing number of multiracial 
schools. According to Frankenberg, Lee, and Orfield (2003), “a substantial 
percentage of students now [2000-2001] attend schools where at least three 
races are each 10% or more of the total student population respectively” (p. 
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28). White students are the least likely and Asian students are the most 
likely to attend multiracial schools. Specifically, 14.3% of white, 28.9% of 
African American, 38.8% of Latino, 75% of Asian American, and 24.9% of 
Native American students attend multiracial schools. 

Students from the most populous racial/ethnic groups—African Ameri- 
cans, Latinos, Asian Americans, Native Americans, and Whites—experi- 
ence patterns of desegregation, segregation, and resegregation differ- 
ently and, therefore, have varying levels of exposure to racial, ethnic, 
cultural, social class and linguistic diversity in the nation’s schools. 
Consider the following trends extracted from studies conducted by Orfield 
and his colleagues: 


African American Students 


@ A steady resegregation of African American students has been 
occurring since 1988. In 2000-2001, the percentage of African American 
students attending predominantly white schools had fallen from 43% in 
1988 to 30% which is about the level of integration that existed in 1969, 
one year after the assassination of Martin Luther King, Jr. (Frankenberg, 
Lee, & Orfield, January, 2003) 


@ In 2000-2001, across the nation 72% of African American students 
attended “predominantly minority” schools that were 50-100% minor- 
ity; one-third or 37.4% of African American students attended “intensely 


segregated” schools that were 90-100% minority; and one in six or 17.8% 
African American students attended “apartheid” schools that were 99- 
100% minority. (Frankenberg, Lee, & Orfield, January, 2003) 


@ In 2001-2002, based on two measures (Black Exposure to Whites and 
Percent Blacks in Majority White Schools) the four most segregated 
states for African Americans were New York, Michigan, Illinois, and 
California; the five most integrated states, Kentucky, Washington, 
Kansas, Nebraska, and Delaware. (Orfield & Lee, 2004) 


Latino Students 


@ Segregation of Latino students has been steadily rising over the last 
three decades. “Latinos are the most segregated minority group...” and 
“_..are segregated both by race and poverty, and a pattern of linguistic 
segregation is also developing.” (Frankenberg, Lee, & Orfield, January 
2003, p. 4) 


@ In 2000-2001, 76% of Latino students attended “predominantly 
minority” schools where 50-100% of the students were minority; one 
third or 37% of Latino students attended “intensely segregated” schools 
that were 90-100% minority; and one in nine or 10.8% of Latino students 
attended “apartheid” schools that were 99-100% minority. (Frankenberg, 
Lee, & Orfield, 2003) 
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@ In 2001-2002, based on two measures (Latino Exposure to Whites and 
Percent Latinos in Majority White Schools), the four most segregated 
states for Latino students were California, New York, Texas, and New 
Mexico; the five most integrated states, Wyoming, Idaho, Utah, Oregon, 
and Nebraska. (Orfield & Lee, 2004) 


Asian American Students 


@ Asian Americans are the most integrated minority group and “expe- 
rience less linguistic segregation than Latinos.” (Frankenberg, Lee, & 
Orfield, January 2003, p. 4) 


@ In 2000-2001, 75% of Asian American students attended multiracial 
schools where at least three races constituted 10% or more of the student 
population (Frankenberg, Lee, & Orfield, 2003), and in 2001-2002 the 
“typical or average” Asian American student attended a school where only 
22% of the other students were Asian American. (Orfield & Lee, 2004) 


Native American Students 


@ In 2000-2001, one in four or 24.9% of Native American students 
attended multiracial schools where at least three races constituted 10% 
or more of the student population. (Frankenberg, Lee, & Orfield, 2003) 


@ In 2001-2002, based on data that included both off- and on-reservation 
schools, the “typical or average” Native American student attended a 
school where one-third or 35.5% of the other students were also Native 
American. (Orfield & Lee, 2004) 


White Students 


@ In 2000-2001, although white students constituted only 60% ofthe U.S. 
school population and minority students were 40% of the school popula- 
tion, the “typical or average” white student attended a school where 80% 
of the students were white. (Frankenberg, Lee, & Orfield, 2003) 


@ In 2000-2001, only 14.3% of white students attended the new multi- 
racial schools where at least three races constituted 10% or more of the 
student population, and, therefore, were the least likely of all ethnic 
groups to attend such schools. Only 10.8% of white students attended 
“predominantly minority” schools with minority populations of 50- 
100%; less than 1% attended “intensely segregated” minority and 
“apartheid” minority schools. (Frankenberg, Lee, & Orfield, 2003) 


@ In 2001-2002, white students were the most racially isolated and 
segregated of all ethnic groups. (Orfield & Lee, 2004) 


Some major conclusions can be drawn from the above findings taken 
from studies conducted by Orfield and his colleagues at the Harvard 
University Civil Rights Project. In general what we can say, based on two 
of the most recent reports, is that we have lost most of the gains that were 
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made toward desegregation during the 1970s and 1980s. Steadily increas- 
ing resegregation of African American students and increasing segrega- 
tion of Latino students throughout the decade of the 1990s has also been 
paralleled with an new emerging pattern of old forms of segregation being 
replicated in the suburbs as more minorities have moved from central 
cities to the suburbs. As segregation has increased throughout 1990s, a 
contrasting trend of multiracial schools has emerged where each of at 
least three racial/ethnic groups represent 10% or more of the student 
body. However, despite the enormous increase of people of color in our 
society since the 1960s as the racial demographics have changed in our 
nation, Whites have been able to maintain their racial isolation 
(Frankenberg, Lee, & Orfield, 2003; Orfield & Lee, 2004). 


Implications for Teacher Education 


The trends regarding desegregation, segregation, and resegregation 
have profound implications for teacher education programs. The trends 
portend that future preservice candidates, regardless of race and ethnicity, 
are more likely to have been educated in segregated school environments 
than in multiracial, diverse schools. For example, most traditional 
teacher-education candidates who will be admitted to teacher education 
programs their junior year in the fall term of 2004 were likely in 
kindergarten in 1989, the year after desegregation peaked in 1988. They 
attended public schools throughout 1990s, a decade of intense resegregation 
and the years during which most of the gains made toward school 
integration in the 1970s and 1980s were lost. They enrolled as freshmen 
at colleges and universities in 2002, almost the same year that school 
desegregation fell back to the low level it was in 1969. 

Currently, approximately 85% of preservice teacher candidates are 
white; the remaining 15% are preservice teachers of color, primarily 
African American, Latino, Asian American, and Native American (Harvey, 
2002). Data from the desegregation studies (Frankenberg et al., 2003 and 
Orfield & Lee, 2004) indicate that the 85% majority white preservice 
candidates, as public school students, will have been the most racially 
isolated and segregated ofall ethnic groups. As the data show, the typical 
white preservice teacher candidate will have attended public schools 
where 80% of the students were white and where exposure to students 
of other ethnic groups will have been minimal. 

As data from the desegregation studies conducted by Frankenberg et 
al. (2003) and Orfield and Lee (2004) have indicated, teacher education 
candidates who are African American, Latino, Asian American, and 
Native American will have had varying levels of exposure to cultural and 
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linguistic diversity. African American preservice teachers in 2004 and 
after will likely have had minimal exposure to other ethnic groups during 
their P-12 public school experiences. In 2001-2002, 72% of African 
American public school students attended majority-minority schools (50 
to 100% minority), 38.4% attended “intensely segregated” schools (90- 
100% minority), and 17.8% attended “apartheid” schools (99-100% minor- 
ity). Like African Americans, Latino preservice teachers throughout the 
present decade will have had limited exposure to diversity through their 
public schooling. In 2000-2001, 76% of Latino public school students 
attended majority-minority schools, 37% attended “intensely segregated” 
schools, and 10.8% attended “apartheid” schools. However, most Colleges 
of Education can expect to admit a few preservice teacher candidates who 
have attended the recently emerging multiracial public schools where at 
least three or more ethnic groups each constitute 10% or more of the total 
student population. Asian American teacher candidates will be the most 
likely of all ethnic groups to have had rich, culturally diverse educational 
experiences since 75% of Asian American students are attending these 
relatively new multiracial schools. About 38.8% of Latino, 28.9% of 
African American, and 24.9% of Native American preservice teachers can 
be expected to have attended multiracial schools. Since only 14.3% of 
white students will have attended multiracial schools, white preservice 
teachers will continue to be the least likely of all ethnic groups to have 
their dispositions and values shaped by culturally diverse educational 
experiences. 

Given this scenario presented above, there are several additional 
implications for teacher education programs in the future: 


1. Many teacher education faculty members will have to adjust 
their expectations regarding the background experiences of their 
students. Teacher educators who had expected future preservice 
teachers to have had more experience with diversity than the 
previous generation of preservice teachers will likely be sur- 
prised and disappointed. 


2. In the future the university and college environment may be 
the first, ifnot also the most, culturally and linguistically diverse 
learning environment experienced by a majority of preservice 
candidates. 


3. Having attended a dual, separate, and segregated public school 
system, the next generation of preservice teachers will likely not 
have experienced a truly multicultural curriculum prior to 
enrolling in an institution of higher education. Consequently, in 
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university and college teacher education programs, preservice 
teachers will likely continue to hear the term multicultural 
education for the first time. 


4. Preservice teachers’ resistance to multicultural teacher edu- 
cation may intensify. What has been called “White resistance to 
multicultural education” in the professional literature is likely to 
become stronger rather than diminish since white students will 
remain the most racially isolated of all the various ethnic groups 
who will be entering teacher education programs. 


5. Field experiences in teacher education programs will be 
affected, too. For some time to come, teacher education field 
experiences will likely be in more racially segregated schools 
than has been the case in the past, although some multiracial 
schools will be available for field experience placements. 


If schoo! segregation continues at the pace witnessed during the 
1990s and if the new emerging trends of segregation within the suburbs 
continue unabated, teacher education programs are likely to find prepar- 
ing teachers for a culturally and linguistically diverse school population 
even a more difficult endeavor than it has been in the past. Historically, 
the primary model for the preparation of teachers has been one in which 
a predominantly 85% white monocultural, monoracial university faculty 
has been training a predominantly 85% white, monoracial and monocul- 
tural college and university population to teach a multiracial, multicultural 
population of P-12 pupils. This model of monoracial, monocultural 
professors teaching monoracial, monocultural university students to 
teach multiracial, multicultural school students has not been working 
very well. It has been extremely difficult to prepare largely monoracial, 
monocultural preservice teachers to have the cross-cultural and inter- 
cultural knowledge, skills, and dispositions to become competent cultur- 
ally responsive teachers. As Cochran-Smith, Davis, and Fries (2004) note 
in their seminal “synthesis of fourteen syntheses” of multicultural 
teacher education research over the last two decades, multicultural 
teacher education has come into its own, at least in its theoretical 
underpinnings and its research base, if not in its fully satisfactory 
implementation. 

Multicultural teacher education has emerged as a type of transforma- 
tive education that seeks to prepare preservice teachers with the 
knowledge, dispositions, and skills that will enable them to be culturally 
responsive practitioners in culturally and linguistically diverse class- 
rooms in the nation’s schools. Simply put, multicultural teacher educa- 
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tion seeks to produce multicultural teachers. Producing multicultural 
teachers is a complex process that involves much more than just surface 
and technical competence in knowledge and pedagogical skills. For a 
majority of preservice teachers, it involves deep-rooted complex trans- 
formations in dispositions, values, and world views regarding diversity. 
As Sonia Nieto (2000) writes, “Becoming a multicultural teacher... 
means becoming a multicultural person” (p. 338). This process of 
recreating monocultural preservice candidates as multicultural people 
and teachers will likely become more challenging in the future as we 
lose the vision of Brown and schools become more segregated by race, 
poverty, and language. 

Finally, if the process of educating primarily monocultural teachers 
is likely to become more complex, designing assessment systems that 
humanely and authentically track and assess the developmental progress 
of teacher candidates is likely also to become more challenging. The 
future of our efforts, I believe, is presently unknown. On the one hand, 
it is very possible that from our evaluation systems we may learn that 
short, two-year teacher education programs are insufficient to provide 
the types of intense, dynamic experiences that recreate monocultural 
candidates into truly competent multicultural practitioners. On the other 
hand, we may learn that the effects of transformative processes are not 
measurable. That is, we may learn that the same technical inadequacies 
and the failure to establish predictive validity that have plagued the field 
of measurement historically will also prove problematic in assessing the 
dispositions, knowledges, and skills that are believed to be essential to 
culturally responsive teaching. 


Conclusion: 
The Primary Task Is To Assess, 
the Greater Task Is To Achieve Educational Justice 


In summary, assessing the multicultural competencies and disposi- 
tions of teacher candidates compels teacher educators to be mindful of the 
challenges ahead. First, unique problems in the assessment of teacher 
candidates are posed by the fervor of what appears to be an era of mean- 
spirited, high stakes testing in P-12 schools. Second, we must also be 
mindful that some College of Education assessment systems, like the 
NCLB assessment and accountability systems, are evolving in question- 
able directions. Furthermore, disturbing trends of segregation and 
resegregation in the P-12 schools portend that both the education of 
future generations of teacher candidates and the assessment of their 
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progress toward becoming competent teachers of culturally and linguis- 
tically diverse pupils will likely become more, not less challenging. 

Can we design humane and fair diagnostic and summative evaluation 
systems that do not adversely affect minority teacher candidates but still 
measure and document preservice candidates’ complex transformation 
toward becoming competent in culturally responsive teaching? I am not 
absolutely certain we can. But I am absolutely certain we must try. And 
I am certain of one other thing. I trust multicultural teacher educators, 
people like those of us assembled at this conference, more than any other 
group of experts, with the difficult task of trying. 

Let me conclude by saying that there is little doubt in my mind that the 
longest running, most embarrassing failure of the nation’s educational 
system is the undereducation of poor children, children of color, and 
children who speak languages other than English. This historic failure 
from colonial America to the present to provide these children with the 
same high quality education that is provided today’s white suburban 
middle-class children constitutes nothing less than educational injustice. 

As Martin Luther King, Jr. once said, “Let us realize the arc ofa moral 
universe is long, but it bends toward justice” (King, 1967, para. 2). Wecan 
achieve educational justice in the United States. Two hundred and 
twenty-eight years is long enough to wait. Every child can learn. What we 
provide children in the suburbs, we can provide the children who have 
historically been left behind. To do so, we must have the will to change. 
Indeed, as Gandhi said, “We must be the change we wish to see” (Gandhi, 
n.d., para. 20). 

Thus, as we address the complex issues of assessing multicultural 
outcomes over the next two days, let us be certain that we do not contribute 
to educational injustice. Rather, let us be certain, cautiously placing each 
foot in front of the other, that we are set on the path that leads to 
educational justice. The burden of our task is heavy. The assessment 
systems we develop must meet higher standards than have come before. 
Let us be mindful of the fact that, as Martin Luther King, Jr. wrote in his 
famous Letter from Birmingham Jail, “Injustice anywhere is a threat to 
justice everywhere” (King, Jr., 1963, p. 78). Let the spirit of achieving 
educational justice guide our footsteps at this conference. 


Notes 


1 This article is a slightly edited transcript of G. Pritchy Smith’s keynote 
address at the National Conference on Assessment of Multicultural/Diversity 
Outcomes on April 2, 2004 in Kansas City, Missouri. It is an invitation to teacher 
educators to develop humane evaluation systems consisting of multiple types of 
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assessment methods that work toward the attainment of educational justice. 
Unlike other articles in this collection, this article is not intended to be a scholarly 
treatment of the topic of assessment. Its tone is personal and conversational. 
With the exception of some alterations for the printed form, Smith’s address 
appears as originally spoken. It should also be noted that some material used in 
this keynote address was originally prepared for an article titled “Desegregation 
and Resegregation after Brown: Implications for Multicultural Teacher Educa- 
tion” in Multicultural Perspectives, 6(4), 26-32. 

* These two reports can be ordered from the Civil Rights Project, Harvard 
University, 124 Mt. Auburn Street, Suite 400, South Cambridge, MA 02138. Tel: 
(617) 496-63667; Fax: (617) 495-5210. These two reports can also be retrieved 
from the following Web site: http://www. civilrightsproject.harvard.edu 
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Multicultural/Diversity Outcomes: 


Assessing Students’ Knowledge Bases 
across Programs in One College of Education’ 
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& Linda Mitchell, Mara Alagic, & Ian Gibson 
Wichita State University 


As the school population in the United States continues to diversify, 
those transformative leaders within educational institutions must chal- 
lenge themselves to adjust and recreate the teaching/learning experi- 
ence to reflect and incorporate this increasing diversity. A team of faculty 
at one mid-western university participated in the grant-funded Emporia 
State University MC/D Assessment Project harnessing collaborative 
synergy from four different components of the College of Education: 
Linda Mitchell, representing Special Education; lan Gibson, represent- 
ing Educational Leadership, Counseling, Education, and School Psychol- 
ogy; Mara Alagic, representing Mathematics Education/Curriculum and 
Instruction; and Tonya Huber, serving as Institutional Coordinator and 
representing the Master of Education in Curriculum and Instruction and 
Foundations of Education (graduate and undergraduate multicultural 
education courses). The team originally included an additional faculty 
member, Innes Villalpando, representing Foundations of Education, 
during the first year of data collection. 


Diversity, Multicultural and Global Perspectives 


In the Professional Standards for the Accreditation of Schools, Col- 
leges, and Departments of Education, The National Council for the 
Accreditation of Teacher Education (NCATE, 2002) defines diversity as 
“differences among groups of people and individuals based on ethnicity, 
race, socioeconomic status, gender, exceptionalities, language, religion, 
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sexual orientation, and geographical area” (p. 53). The concept of 
multicultural perspective is defined as “an understanding of the social, 
political, economic, academic, and historical constructs of ethnicity, race, 
socioeconomic status, gender, exceptionalities, language, religion, sexual 
orientation, and geographical area” (p. 54). Similarly, the corollary global 
perspective is defined as “an understanding of the interdependency of 
nations and peoples and the political, economic, ecological, and social 
concepts and values that affect lives within and across national bound- 
aries. It allows for the exploration of multiple perspectives on events and 
issues” (p. 53). 

The responsibility of schools and colleges of education becomes that 
of determining not only what to teach to accomplish the development of 
these multicultural and global perspectives and knowledge bases, but 
how to assess the understanding of candidates regarding diversity, 
multicultural and global perspectives. In other words, are the teachers 
we certify equipped with the knowledge, skills, and dispositions to work 
effectively in today’s increasingly diverse classrooms? To determine an 
answer to this question in one mid-western college of education, this 
longitudinal study was undertaken. The members of this Multicultural/ 
Diversity (MC/D) team identified themselves with the pedagogical orien- 
tation described by G. Pritchy Smith (1998) as “multiculturalists and 
reconstructionists who constitute a much smaller group [than diversity- 
blind genericists] of scholars and practitioners who hold that generic 
teacher training is not sufficient” (p. 18). As culturally responsive teacher 
educators committed to culturally responsible pedagogy (Huber, 2002), 
the team embarked on this study. Smith’s (1998) Knowledge Bases for 
Diversity were foundational to the multicultural courses taught, the 
team members’ discussions, and the analysis of collected data. 


Project Framework 


An Emporia State University (ESU), Kansas, Multicultural/Diversity 
(MC/D) Task Force initiated this project in 1997 with a 3-year grant from 
the United States Department of Education to create, pilot, and refine 
MC/D knowledge, dispositions, and performance instruments, including 
multiple formats and options. The lead author on this article served as an 
“outside consultant” during this phase of the project. In 2001, the U. S. 
Department of Education awarded ESU another grant (Fund for the 
Improvement of Postsecondary Education, FIPSE). The grant furthered 
the project, in part, by funding 10 universities across the United States 
in developing an evaluation/assessment plan specific to individual pro- 
gram needs. Copies of all instruments were provided in bound copy to 
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each of the universities. The lead author was institutional coordinator at 
one of the 10 institutions for this phase of the project. 

As one of the 10 funded universities in this project, the MC/D Team 
at this Midwestern university correlated components of the individual 
assessment instruments to the 15 parameters of Smith’s (1991, 1998, 
2001; see, also, Huber, 2002) Knowledge Bases for Diversity (see 
Appendix). Asimilar type of correlation was completed by the consultant 
team in the early stages of the MC/D Project (see, Ambrosio, 2000). The 
University’s Core I in Teacher Education (previously Block One) had 
been aligning course assignments and field experiences with the 
knowledge bases since 1991 (see Huber, 1991; Huber, Kline, Bakken, & 
Clark, 1997; Huber & Warring, 2004). Inclusion of Smith’s Knowledge 
Bases was being considered by additional faculty members during the 
time reported in this study. In this study, KBase is used as shorthand 
to refer to the Knowledge Bases. 


Assessments 


The initial instruments were prepared on paper and distributed with 
bubble sheets following informed consent. In the third year of data 
collection, the instruments were established as on-line surveys using a 
new system available through computing services. For multiple reasons 


that are not the focus of this report, data was lost or inaccessible because 
of this step. The reported findings were certainly impacted by implemen- 
tation of the digital version of the assessment instruments. A lingering 
issue will be considered regarding the technological aspect of institution- 
alizing such broad-scale assessments. 

Four instruments were used to collect data once informed consent 
had been granted. In addition, a demographic form was requested to 
provide a basis for comparison of programs and cohorts. A brief discussion 
of the instruments follows. Appendix 1 provides a content analysis of the 
4 instruments. The following instruments were used: 


@ Multicultural Content Test-Educational (MCCT-E). The MCCT-E 
consists of two forms (A and B) each containing about 37 multiple-choice 
items designed to estimate a respondent’s level of multicultural/diver- 
sity knowledge as related to teacher education. Items cover a range of 
complexity from factual to evaluative. The MCCT-E achieved internal 
consistency validity and almost all items showed a high degree of 
discrimination and passed item difficulty and distractor analysis 
(Ambrosio & Seguin, 2003). 


@ Professional Beliefs about Diversity Scale—Education (PBDS-E).The 
PBDS (Pohan & Aguiler, in Ambrosio, 2000) is a 15-item, 5-point Likert 
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scale. It measures attitudes and beliefs about diversity issues. The 
PBDS achieved a reliability estimate of 0.85 (Ambrosio, 2000, p. 5). 


@ Multicultural Questionnaire Revised (MCR). The MCRisa30-item, 5- 
point Likert scale. It measures attitudes toward national, interna- 
tional, and educational diversity issues. The MCR achieved a reliability 
estimate of 0.88 (Seguin, Ambrosio, Hogan, 2000, p. 47). 


@ Knowledge-Based Diversity Questionnaire (KBDQ). The KBDQ is a 37- 
item questionnaire with three priority columns to indicate top 5 items 
as 1* priority learning outcomes for students in teacher education, 5 
items given 2™ priority, and 3 items given 3" priority. Candidates are 
also to indicate which topics were covered in one of their courses. Several 
open-ended items complete the questionnaire. 


An analysis of questions and responses on each of the instruments 
described above led the research team to formulate a conceptual connec- 
tion between items on each test and the correlating MC/D concepts. A 
summary of the results of that process can be found in Appendix 1 and 
represents a construct map of the knowledge bases considered to be core 
components of multicultural awareness and understanding. Referring to 
this construct map throughout the following discussion will provide the 
reader with a structure upon which to base an evolving understanding of 
the discussion as it unfolds. 

The assessments were administered to candidates entering the teacher 
education program; to candidates completing the foundations block of 
teacher education, including courses in multicultural education, special 
education, and growth and human development; candidates graduating 
from the undergraduate program; and graduate candidates in special 
education, curriculum & instruction, and educational leadership. Nearly 
230 candidates participated, with some of them providing data at multiple 
checkpoints in the program. This report will consider the undergraduate 
participants, a total of 120 candidates and focus on data collected with the 
MCCT-E instrument in consideration of 7 of the 15 knowledge bases. Space 
does not permit for the detailed analysis of each of the 15. 


Knowledge Base 1: 
Foundations of Multicultural Education 


Four items on the MCCT-E (form A) were identified that addressed 
the “Foundations of Multicultural Education” knowledge base: #6, #30, 
#34, and #35. The items were identified based on the content of each 
statement or question. Therefore, it would be inaccurate to determine 
that the items listed in Appendix 1 are a comprehensive identification of 
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the knowledge base to which they are attributed. Rather, these items 
were identified because they addressed one or more aspects of the 
knowledge base. The same caveat is true throughout the items analyzed. 
Correct responses are indicated by italic. 


Consideration of KBase 1 Questions 


MCCT-E question 6. What is the purpose of multiculturalism in 
schools? (a) to help assimilate immigrant students’ cultures into the 
mainstream of American life; (b) to reduce prejudice, foster tolerance, and 
improve the academic achievement of all students; (c) to support students 
in the maintenance and preservation of their own cultures; (d) to 
assimilate students into the “melting pot” of the United States as well as 
to foster students’ respect for the existence of various cultures. 

Analysis of question 6. In his explanation of Knowledge Base 1, Smith 
(1998) identifies six components, the second of which includes “key terms 
that constitute the concepts and language of multicultural education such 
as diversity, cultural pluralism, assimilation, culture, acculturation, 
xenophobia, ethnocentrism, Eurocentrism, racism, classism, sexism, 
homophobia, prejudice, discrimination, antiracism, antibias, inclusion, 
exclusion, etc.” (p. 24). 

Options “a” and “d” both use the term assimilation, without regard for 
the pluralistic ideology that respects different cultures without request- 
ing assimilation into the macroculture—the pervasive national culture 
(Huber, 2002, p. 2; see, also, Sleeter & Grant, 1999, pp. 158-160). “Only 
limited structural assimilation has occurred for any of the groups 
[oppressed groups, especially African Americans, Native Americans, and 
Mexican Americans] except white European immigrants” (Gollnick & 
Chinn, 2002, p. 14). Additionally, option “d” proposes a melting pot 
interpretation of American culture, a metaphor which has been discred- 
ited by somany (e.g., Gollnick & Chinn, 2002; Gordon, 1964; Huber, 2002; 
Smith, 1998; Takaki, 1993) because of the people who were not included 
in the meltdown. The more applicable metaphors include mosaic, patch- 
work quilt, and stew. Option “c” provides a challenging distractor given 
that respect for cultures is a tenet of the multicuralist, but academic 
success would not be accomplished if that were the only goal, and 
academic success for all students is a principle of MC Ed. Thus, option “b” 
addressing dispositions, actions, and achievement is the optimal answer. 

MCCT-E question 30. In a class discussion of current events, Ms. 
Wagner asks students to comment on the Gulf War. One student shouts 
with pride “My dad’s over there kicking Saddam’s butt!” Several students 
chorus approval, but one student, who immigrated from the Middle East, 
grabs her backpack and rushes out of the classroom visibly upset. Which 
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general course of action (of the ones listed below) would you recommend 
to the teacher to promote conflict resolution in this instance? (a) Make 
time for discussion during this or the next class time so that students can 
learn of each other’s motives, feelings, and perspectives on the issue. (b) 
Reprimand the student making the comment and ask them to apologize. 
(c) Reprimand the student who left for disrupting class and leaving 
without permission. (d) Have students each write a reflective paper on the 
war so that they can deal with their feelings and tell their perspective on 
the issue. (e) Report to the office that a student left the classroom and 
continue with class discussion. 

Analysis of question 30. Ambrosio (2000) explains in “Appendix B: 
Summary of Issues Addressed from Consultant Comments” that this 
item was taken from the vignette section and responses were based on 
those considered as potentials or actually submitted: Some teachers have 
a tendency to treat conflict as a management issue only, ignoring the 
underlying diversity issue, in this case choosing option “e” as the answer. 
Options “b” and “c” are then also interpreted as management (punitive 
reprimand) issues. The competing option is “d” but does not deal with 
conflict resolution in the context of the environment. Simply, students do 
not have an opportunity to engage in rich dialogue to facilitate sensitivity 
to other’s perspectives and feelings. A reflective paper does not address 
the potential for future conflict nor does it promote reciprocal assimila- 
tion of perspectives. Option “a” is considered the optimal answer (albeit 
a general heuristic) because it deals with two of the purposes of 
multicultural education: awareness of the diversity of perspectives and 
prejudice reduction (p. 33). 

MCCT-E question 34. Mr. Ri facilitates a classroom discussion of 
“Family.” He asks each student to tell the class what family means to 
them. He then has students compare and contrast their responses. Which 
statement do you feel is the best critique of Mr. Ri’s approach? (a) Mr. Ri 
is wasting valuable class time on an activity that does not clearly have a 
goal. (b) Mr. Riis giving students an opportunity to become vocal in the 
class which may reduce their shyness during later discussions. (c) Mr. Ri 
is cleverly learning about the individual (and, perhaps, non-traditional) 
family structures of his students. (d) Mr. Riis clueless as to what the idea 
of family means and is relying on student definitions. 

Analysis of question 34. Ambrosio (2000) provided the following 
rationale: “This item was constructed to address the assumptions some 
teachers make about family structures. It should be considered an easy 
item to complete” (p. 35). 

MCCT-E question 35. As an educational philosophy, “pluralism” (a) 
provides additional obstacles and problems for teachers to overcome; (b) 
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allows for student diversity to become a strength in the classroom; (c) 
limits the amount of school time devoted to learning basic skills; 
(d) makes it easier for students who are immigrants to assimilate into a 
shared culture. 

Analysis of Question 35. Ambrosio (2000) defined #35 as an affective 
content item, explaining “Nieto (1992) cited an ethnographic study by 
Grant and Sleeter in which they found that ‘teachers tended to see it 
[pluralism] not as an asset [i.e., option “b”] , but rather as an obstacle to 
be overcome [i.e., option “a”]’ (p. 26). Options “c” and “d” present other 
misperceptions or beliefs held by some teachers” (p. 36). 


Interpretation of KBase 1 


In the findings from the graduating seniors who responded to these 
items (n=16), the mean average of correct answers provided to these 4 
questions was 58% with a range of 75 and standard deviation of 30. The 
importance of the issues considered in these 4 items—the purpose of 
multiculturalism, awareness of the diversity of perspectives, prejudice 
reduction family structure, and pluralism—begs the dismissal of these 
findings as the result of a few bad answers. 

The MCCT-E was also administered to another group of candidates, a 
cohort of 26 individuals who entered a site-based master of education (Med) 
program in the fall of 2000 and worked together with the same lead 
instructor for the next four semesters, completing the 24-hour core of 
coursework in spring 2002. Candidates took the MCCT-E October 2000 and 
again in May 2002. The overall pre-test mean of 75.7 (SD = 23.7) increased 
toa mean of 81.5 (SD = 18.1) on the post-test, a change of 5.8 with a similar 
gain in the standard deviation. The initial pre-test median of 81.5 rose to 
82.5. A lingering issue is that when the scores were considered for each of 
the 26 candidates, only 9 increased their overall score on the post-test. 


Knowledge Base 3: 
Cultural and Cognitive Learning Style Theory and Research 


Three items on the MCCT-E (form A) address the “Cultural and 
Cognitive Learning Style Theory and Research” knowledge base: #14, 
#18, and #20. 


Consideration of KBase 3 Questions 


MCCT-E question 14. Based on the work of researchers studying 
learning styles, students may differ in preferences associated with 
surroundings, and these differences (a) have a limited effect on the 
student; (b) cannot predict which learning environment will be most 
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effective for each student; (c) can predict which learning environment will 
be most effective for each student; (d) can predict the students who are in 
need of remedial education. 

MCCT-E question 18. Research on African American students sug- 
gests that a common learning style is (a) reflective; (b) visual/global; (c) 
field independent; (d) verbal/analytic. 

MCCT-E question 20. With respect to the effect of inequitable school 
funding (e.g., schools with more money vs. schools with less money), 
which of the following statements do you think is true? (a) Less school 
funding means less qualified teachers, which decreases student learning. 
(b) More school funding means smaller classroom sizes, which increases 
student learning. (c) More school funding means better materials and 
books, which increases student learning. (d) None of the above is 
necessarily true. 


Interpretation of KBase 3 


Items #14 and #18 further support the idea of creating culturally and 
cognitively aware learning environments in order to facilitate quality 
learning experiences for ALL students (Huber, 2002). Item #20 assesses 
individual’s belief about effects of funding to learning. According to 
Ambrosio (2000), this item could convey that lack of funding cannot be 
used as an excuse for failure. 

It is somewhat disappointing that this group of candidates (n=16) 
responded so that the mean average of correct answers provided to these 
3 questions was 58% with a range of 100 and standard deviation of 33. 
Candidates in the surveyed population took multicultural diversity and 
growth and development classes in addition to weekly field experiences 
in diverse classroom environments. 


Knowledge Base 4: 
Language, Communication, and interactional Styles 


Nine MCCT-E (form A) questions addressed the “Language, Commu- 
nication, and Interactional Styles” knowledge base: #1, #9, #13, #15, #21, 
#22, #25, #28, and 32. The nine items under analysis for this section of the 
knowledge base appear below. To demonstrate the approach taken in 
construction of the items, and the rationale behind them, two items, #21 
and #22 below are analyzed in further detail. They appear out of 
numerical order in this set for the sake of demonstration. (For further 
examples of a similar analysis for the remainder of items in this section 
of the knowledge base, refer to the Report on Multicultural / Diversity 
Content Test for Teacher Educators, in Ambrosio, 2000). 
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MCCT-E question 21. Ms. Tolwinais having trouble with Teresa, one 
of her students. Teresa always looks at her feet when Ms. Tolwin speaks 
to her. What advice would you give Ms. Tolwina to help her solve her 
problems? (a) Teach Teresa the importance of eye contact in communi- 
cation. (b) Don’t assume students aren’t paying attention when they don’t 
look you in the eye. (c) Don’t ask Teresa questions unless she is alone or 
outside of class. (d) None of the above. 

Analysis of question 21.This item addresses the issue of the variation 
in communication styles often attributed to various cultural preferences. 
Ambrosio (2000) suggested that teacher education faculty have focused on 
this issue and have recommended its inclusion in the instrument. This 
item concentrates specifically upon non-verbal communication. It is 
constructed in such a way that the philosophical foundations of reviewers’ 
responses can be gauged from their responses. The first choice empha- 
sizes assimilation from the perspective of adhering to the conforming 
nature of traditionally expected school behaviors. The third choice 
assumes the reverse, an accommodating orientation where the teacher 
does not address the issue nor appears to understand or explore the 
etiology of the behavior. The “None of the above” response is designed to 
single out those who fail to apply critical thinking to the situation and are 
ready to ignore the cultural implications of the behavior. 

MCCT-E question 22. Ms. Wolinski teaches in an economically and 
culturally diverse district. She periodically sends home notices, announce- 
ments, and “notes from the teacher.” She notices several of her students 
consistently forget to bring back notes which need parent or guardian 
signatures. What do you feel is the most plausible explanation for the lack 
of report? (a) The children are probably forgetting or don’t care. (b) The 
teacher is probably disliked by the parents of the children who do not bring 
back the notes. (c) The notes are in English which may be difficult for some 
parents to read. (d) The parents are probably too lazy or don’t care. 

Analysis of question 22. This item is similar in intent to question 21, 
in that it focuses upon another important aspect of school level commu- 
nications—this time, with parents. It represents another example of the 
need to develop in teachers the ability to respond appropriately in 
culturally sensitive interactions. 


Other MCCT-E Questions Considered in KBase 4 


MCCT-E question 1. Melinda is a first-year teacher in a culturally 
diverse classroom. After a few months, she notices that she infrequently 
sees the parents of her Hispanic American students even though she 
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speaks Spanish quite well and has communicated that to parents by 
sending home letters written in both English and Spanish. What is the 
most likely reason for what Melinda is perceiving as infrequent parent 
involvement? (a) They probably don’t like her because she is a female. 
(b) They probably are embarrassed that their Spanish isn’t correct. (c) 
They probably don’t want their child going to an English-speaking 
school. (d) They probably are not used to being involved in the school life 
of their children. 

MCCT-E question 9. Which of the following best explains the under- 
lying reason that the dominant society wanted to teach Native Ameri- 
cans? (a) The whites’ goal was for greater social harmony and cultural 
understanding through educating Native Americans. (b) The whites 
believed that Native Americans would coexist more easily with whites if 
they knew how to read and write. (c) The whites wanted to teach Native 
Americans how to read and write so they could convert them to Christian- 
ity and destroy Native American culture. (d) The whites wanted to 
produce liaisons between the white American government and the 
Native American nations. 

MCCT-E question 13. Children who experience academic difficulties 
due to lack of proficiency in English (a) are sometimes assigned to special 
education. (b) are shown to have low IQ’s. (c) Will never find a group with 
which to identify. (d) Usually come from single-parent families. 

MCCT-E question 15. Which of the following would represent the best 
effort a teacher could undertake to respect cultural diversity in his or her 
classroom interactions with students? (a) Have the bulletin boards 
indicate an appreciation for one culture. (b) Allow other students to 
express diverse opinion. (c) Understand the implications of the various 
structures and roles of extended and nuclear families on the classroom. 
(d) Provide organizational patterns that result in segregation of some 
learners according to culture or social class. 

MCCT-E question 25. According to research and expert opinion, what 
is the most important way to get parents from a variety of cultural 
backgrounds to become involved in the education of their children? (a) 
Hold Parent-Teacher conferences on a variety of evenings. (b) Seek 
personal contact with parents and develop one-on-one relationships. (c) 
Send out classroom newsletters. (d) Give parents an opportunity to 
volunteer to help in class. 

MCCT-E question 28. The Dupont school district engages in a 
comprehensive effort to teach English to students who speak English as 
a second language. The goal of this effort is English proficiency. What do 
you think is the most likely short-term outcome? (a) Students will know 
the convention of the English language, but they will probably still have 
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difficulty gaining a deep understanding of concepts of Western (American) 
culture. (b) There will be noticeable differences in standardized test 
scores among students who speak English as a second language. (c) 
Students will be more able to relate to each other. (d) Teachers will be able 
to use more traditional assessments. 

MCCT-E question 32. Mr. Villani, an excellent teacher, moves from 
aschoolin a suburban community on the outskirts ofa large city toalarge 
inner-city school with a much more diverse population. Which of the 
following is the best way for Mr. Villani to find out about the ethnic and 
cultural make-up of the community? (a) Reading a book about the 
community. (b) Volunteering in community organizations. (c) Getting the 
official Population Census. (d) Contacting the Chamber of Commerce. 


Interpretation of KBase 4 


Each of the questions incorporated reference to one or more of the 
following topics related to the knowledge base of Language, Communica- 
tion, and Interaction Styles as defined by Smith (1998, 2000): social 
interactions, cultural learning styles, ESL” strategies, language acquisi- 
tion (for both native English speakers and speakers of languages other 
than English), mode of instruction and language of instruction, and 
incorporating inclusive practices. It is clear, following an analysis ofeach 
of these items, that a variety of levels of Bloom’s taxonomy have been 
incorporated into their construction (e.g., knowledge comprehension, 
analysis, evaluation). Further, in the construction of this collection of 
items, an attempt has been made to ensure that they are appropriate for 
respondents who are specializing at all grade levels of schooling. These 
items cover a variety of content areas, for example, family, respect, how 
to engage in culturally sensitive situations, creating a learning environ- 
ment, and history of sexism/racism (Ambrosio, 2000). 

In the findings from the graduating seniors who responded to these 
items (n=16), the mean of the correct responses provided for these items 
across all 9 questions was 68% with a range of 100 and standard deviation 
of 31.6. While the real value of these statistics can be questioned based 
on the small N of these responses, with a range and standard deviation 
on the order of these results, one might question the meaning of the 
statistic of central tendency, and the ability of the item set to discrimi- 
nate. It would seem that while the mean appears to be high, the 
magnitude of the SD would suggest that more than one of the choices on 
these four choice items were selected by a similar number of respondents. 
Consequently, the relative value of these statistics, interpreted sepa- 
rately for these item sets, is questionable. 





Multicultural/Diversity Outcomes 


Knowledge Base 7: 
Effective Strategies for Teaching Minority 
and Low-achieving Students 


Three items on the MCCT-E (form A) addressed the “Effective 
Strategies for Teaching Minority and Low-achieving Students” knowl- 
edge base: #11, #26, and #31. 


Consideration of KBase 7 Questions 


MCCT-E question 11. The traditional classroom structure works 
against students of lower socio-economic status because: (a) children from 
homes with lower incomes tend to be less intelligent; (b) of the mismatch 
between the cooperative orientation of many students from lower income 
and minority groups, and the competitive orientation of the school struc- 
ture; (c) lower income and minority students are not receiving enough 
attention from their teachers; (d) they flourish in competitive activities. 

MCCT-E question 26. Ms. Miranda is a first-year teacher in a school 
district with a diverse population and with families who, generally 
speaking, have low incomes. She wants to invite successful professionals 
to her class to serve as models to show her students that they, too, can 
be successful professionals. Which of the following professional models do 
you think would convey this idea the best to her students? (a) Geta, an 
African-American physicist on faculty at a prestigious university in a 
neighboring city; (b) Yemita, a Hispanic-American who owns a local 
business; (c) Darla, a nationally renowned writer and author of “Contri- 
butions of Female Scientists in American History;” (d) The Surgeon 
General; (e) All of the above. 

MCCT-E question 31. Which of the following is the best example of 
utilizing community resources in the classroom? (a) Go to the local 
grocery store and observe people and send reports to local newspapers; 
(b) Study students in the classroom; (c) Hold after-school functions for all 
in a community recreation center; (d) Use business and community 
leaders to implement a project that helps the community. 


Interpretation of KBase 7 


The mean average of correct answers provided to the 3 questions was 
46% with a range of 67 and standard deviation of 23. Only the first item 
(#11) focuses on the classroom structure while the other two (#26, #31) 
address utilization of community resources. Without additional explora- 
tion, it is not clear why the mean would be as low as it is. The same as 
above, we could argue that the number of items is small and that small 
mistakes significantly “shrink” the overall result. It is also important to 
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mention that Ambrosio (2000) argued that the item #26 was constructed 
to “gauge the mindset of the respondents in terms of their awareness of 
the impact of local community representation in the classroom (as 
opposed to models that students may feel are “out of reach to them”). He 
explained that “option “b” (the correct response) spells out ethnicity and 
identifies the model as being from a local community. The subtlety of this 
item should earn it a high difficulty rating” (p. 30). The same may be said 
of the correct answer expected for #31 which requires students to select 
the “best” answer from a selection of actions that are all positive 
responses to the question. 


Knowledge Base 9: 
Foundations of Multicultural Education Effects of Policy 
and Practice on Culture, Race, Class, Gender, 
and Other Categories of Diversity 


Seven items were identified on the MCCT-E (form A) that addressed 
the “Effects of Policy and Practice on Culture, Race, Class, Gender, and 
Other Categories of Diversity” knowledge base: #2, #7, #10, #12, #16, #19, 
and #20. Each of the following items incorporated reference to one or more 
of the topics connected to the knowledge base relating to the “Effects of 
Policy and Practice on Culture, Race, Class, Gender, and Other Categories 
of Diversity as defined by Smith (1998, 2000): classism/funding, racism, 
sexism; school choice, privatization, vouchers; ability grouping, tracking; 
dominance; segregation/desegregation/integration; compensatory educa- 
tion, special education funding; interaction patterns; ability-level group- 
ing; equal educational opportunity; religious differences and pluralism; 
policy and practice bias; proactive inclusion; national identity. Each item, 
as demonstrated above, has been developed following the application of a 
rationale that can be found in the report on the instrument (Ambrosio, 
2000). A similar range of coverage on Bloom’s taxonomy, and on item 
appropriateness for grade level specialists, is found for these items as for 
items related to Language, Communication, and Interaction Styles. The 
content area coverage is also similar with the addition of a focus on 
required terms (in this case pluralism), on policy and philosophy (title 
programs, desegregation, curriculum tracking, law), and on the effects of 
inequitable funding on curriculum, instruction, and learning. 


Consideration of KBase 9 Questions 


MCCT-E question 2. If cultural pluralism were part of a U.S. school, 
how would that affect a group of immigrant students from Portugal? (a) 
They would mingle together during school, but teachers would encourage 





38 Multicultural/Diversity Outcomes 





them to become Americanized and make U.S. friends. (b) The school they 
attended would hold a “Portugal” month with banners and posters of 
Portugal in the hallways. (c) The teachers would treat the students from 
Portugal warmly and would make sure that the U.S. students would do 
the same. (d) The students from Portugal would be encouraged to treasure 
their culture, and teachers would provide ways for the U.S. students to 
learn about life in Portugal. 

MCCT-E question 7. Programs such as Title I of the Elementary and 
Secondary Education Act, Head Start, and Upward Bound were designed 
to assist students who (a) are from a disadvantaged socioeconomic 
background. (b) do not speak English as a first language. (c) have 
developmentally delayed speech. (d) are not very smart. 

MCCT-E question 9. Which of the following best explains the under- 
lying reason that the dominant society wanted to teach Native Ameri- 
cans? (a) The whites’ goal was for greater social harmony and cultural 
understanding through educating Native Americans. (b) The whites 
believed that Native Americans would coexist more easily with whites if 
they knew how to read and write. (c) The whites wanted to teach Native 
Americans how to read and write so they could convert them to Christian- 
ity and destroy Native American culture. (d) The whites wanted to 
produce liaisons between the white American government and the 
Native American nations. 

MCCT-E question 12. Research on school desegregation shows that, 
in general, such programs have: (a) Not raised student achievement, but 
have improved the quality of the education received. (b) Helped in 
addressing problems in funding, socialization, and technology. (c) Sur- 
passed expectations by resulting in large achievement gains. (d) Raised 
the achievement scores of students to a small degree. (e) Both b and d. 

MCCT-E question 16. According to the critics of the process of 
tracking in schools, one of the main criticisms is that it: (a) Lacks 
emphasis on building the social skills necessary for children’s achieve- 
ment in society. (b) Promotes the needs of the lower track students to the 
detriment of high track students. (c) Often creates low track classes that 
are predominately composed of students from higher socioeconomic 
backgrounds. (d) Often creates low track classes that are predominately 
composed of students from lower socioeconomic backgrounds. 

MCCT-E question 19. All of the following are true about the Supreme 
Court’s decision in Brown v. Board of Education of Topeka (1954) 
EXCEPT: (a) The decision made the practice of separate but equal 
facilities in education unconstitutional. (b) The decision overturned an 
earlier Supreme Court ruling in Plessy v. Ferguson (1896). (c) The 
decision encouraged an already emerging Civil Rights movement. (d) The 
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decision resulted in immediate desegregation of all public facilities. (e) The 
decision led to a protest in 1957 in Little Rock, Arkansas, by angry whites 
who refused to allow black students to attend the local high school. 

MCCT-E question 20. With respect to the effect of inequitable school 
funding (i.e., schools with more money vs. schools with less money), 
which of the following statements do you think is true? (a) More school 
funding means smaller classroom sizes, which increases student learn- 
ing. (b) More school funding means better materials and books, which 
increases student learning. (c) Less school funding means less qualified 
teachers, which decreases student learning. (d) None of the above are 
necessarily true. 


Interpretation of KBase 9 


In the findings from the graduating seniors who responded to these 
items (n=16), the mean of the correct responses provided across all seven 
questions was 72% with a range of 100 and standard deviation of 30.6. 
Similar conclusions can be made on this item set as were made for the 
previous set of items related to Language, Communication, and Interac- 
tion Styles. While the real value of these statistics can be questioned 
based on the small N of these responses, with a range and standard 
deviation on the order of these results, one might also question the 
meaning of the statistic of central tendency, and the ability of the item set 
to discriminate. It would seem that while the mean appears to be high, 
the magnitude of the standard deviation would suggest that more than 
one of the choices on these four choice items were selected by a similar 
number of respondents. Consequently, the relative value of these 
statistics, interpreted separately for these item sets is questionable. 


Knowledge Base 10: 
Culturally Responsive Diagnosis, 
Measurement, and Assessment 


Only two items on the MCCT-E (form A) addressed the “Culturally 
Responsive Diagnosis, Measurement, and Assessment” knowledge base: 
#4 and #10. 


Consideration of KBase 10 Questions 


MCCT-E question 4. Which student group is probably under-repre- 
sented because of current gifted identification practices? (a) girls, (b) 
Asian students, (c) White males, (d) economically disadvantaged minority 
students. 

MCCT-E question 10. Historically, acommon stereotype existed that 
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Hispanic American children were intellectually less capable than Euro- 
pean American children. Which of the following best describes how 
standardized testing compounded that misconception? (a) It demonstrated 
that Hispanic American children’s Spanish grammar was less logical than 
European American children’s English grammar; (b) Many standardized 
tests included advanced cognitive skills that many Hispanic American 
children could not perform; (c) The time limited on standardized tests was 
rigid, not allowing Spanish speaking children sufficient time to complete 
the tasks, and their scores suffered; (d) Standardized tests like the I.Q. test 
were culturally biased, because minorities typically were not exposed to the 
same curriculum as children from the dominant culture. 


Interpretation of KBase 10 


Use of MCCT-E for determination of candidate/faculty knowledge, 
skills, and/or dispositions regarding Culturally Responsive Diagnosis, 
Measurement, and Assessment is given extreme caution. Two questions, 
one concerning gender bias, and another with Hispanic culture bias are 
not broad enough to discern need for program improvement in this area. 


Knowledge Base 15: 
Foundations of International and Global Education 


Three items on the MCCT-E (form A) addressed the “Foundations of 
International and Global Education” knowledge base: #2, #29, and #30. 


Consideration of KBase 15 Questions 


MCCT-E question 2. If cultural pluralism were part of a U.S. school, 
how would that affect a group of immigrant students from Portugal? (a) 
They would mingle together during school, but teachers would encourage 
them to become Americanized and make U.S. friends. (b) The school they 
attended would hold a “Portugal” month with banners and posters of 
Portugal in the hallways. (c) The teachers would treat the students from 
Portugal warmly and would make sure that the U.S. students would do 
the same. (d) The students from Portugal would be encouraged to treasure 
their culture, and teachers would provide ways for the U.S. students to 
learn about life in Portugal. 

MCCT-E question 29. You are offered a teaching position at Central 
High School. To get a better idea of the school population, you look at the 
curriculum for the first semester of school in several subject areas. You 
observe that students will be studying Shakespeare’s Tempest, Charles 
Dickens’ Great Expectations, and 18“ century British poets in the Junior 
English Lit class. In World History, students will be studying Ancient 
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Rome, Ancient Greece, and the Crusades. In Art class, students will be 
studying the cave paintings in Spain and France, the French Impression- 
ists, and the Dutch Masters. The curriculum is presented in the tradi- 
tional lecture teaching strategy. Which of the following statements do 
you think is the best critique of this curriculum? (a) The curriculum 
covers classic material that all students should be exposed to; (b) The 
curriculum misses some of the better classic works in literature, history, 
and art; (c) The traditional lecture teaching strategy is not for all learners; 
(d) The curriculum consists only of European experiences; (e) The 
curriculum exemplifies diversity by covering a variety of countries/ 
cultures (e.g., Spain, France, Dutch, Rome, Greece). 

MCCT-E question 30. In a class discussion of current events, Ms. 
Wagner asks students to comment on the Gulf War. One student shouts 
with pride “My dad’s over there kicking Saddam’s butt!” Several students 
chorus approval, but one student, whoimmigrated from the Middle East, 
grabs her backpack and rushes out of the classroom visibly upset. Which 
general course of action (of the ones listed below) would you recommend 
to the teacher to promote conflict resolution in this instance? (a) Make 
time for discussion during this or the next class time so that students can 
learn of each other’s motives, feelings, and perspectives on the issue. (b) 
Reprimand the student making the comment and ask them to apologize. 
(c) Reprimand the student who left for disrupting class and leaving 
without permission. (d) Have students each write a reflective paper on the 
war so that they can deal with their feelings and tell their perspective on 
the issue. (e) Report to the office that a student left the classroom and 
continue with class discussion. 


Interpretation of KBase 15 


At first consideration, a mean of 69% with a standard deviation of 28 
and range equal to 100 appears high in comparison with findings in the 
other knowledge bases. Closer analysis of the questions and related 
answers, however, reveals that this group of candidates may lack knowl- 
edge of some essential elements about international and global education. 
This group of candidates participated in an online global learning project 
in which they had been paired with peers in Australiain a similar class. The 
focus of the project was (a) to exchange experiences in learning to teach 
science in elementary/primary schools, and (b) to develop a more interna- 
tionalized perspective on teaching and learning. The following excerpt 
from the report on that project evidences this perspective. 

Extended discussion and debate about values, assumptions and 
issues confronting individual cultural perspectives were not evident. 
There were however, exchanges that addressed individual student’s 
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interests and knowledge of each other’s cultures at a surface level. For 
example, information about personal relationships, sport and lifestyle 
was common as detailed in this student’s comments: 


After e-mailing back and forth a few times with my e-mate, I can say that 
Inow know 2 little bit about Australia and the lifestyle they live there. They 
too gotocollege for 4 years to get a bachelor’s degree. They also have education 
degrees in early childhood, primary, and secondary. One project that we are 
both doing is designing a unit made up of 4 lesson plans. Away from the 
subject of school, I’ve learned what netball is and how you play it. My e-mate 
is really good at it and her sister also plays it. Her sister represents 
Australia doing it, which I thought was really cool. (Student from Kansas, 
reported in Watters, Rogers, Gibson, Alagic, & Haack, 2004, p. 7) 


Similar surface details about lifestyles and practices were evident in 
transactions relating to universities in the United States identifying with 
“mascots”—a practice unknown in Australia. In a discussion of the 
teaching of mathematics, the teaching of the metric system generated 
debate among the students and revealed a number of assumptions about 
the use of the metric system internationally. Indeed, one Australian 
student thought she was teaching the English system and described her 
understanding of the system as the English Metric System. 

It appears that the online global learning project was somewhat 
helpful, but not as much as expected. Considering the relatively large 
number of credit hours in methods classes (12 during Block III) and a 
variety of field experiences (a total of 4 different placements) in diverse 
environments through all blocks, the Effective Strategies for Teaching 
Minority and Low-achieving Students knowledge base requires consider- 
able attention in the future. Candidates are required (at least in one course 
and related field experience) to incorporate strategies for teaching minor- 
ity and low-achieving students in every lesson plan and to differentiate 
instruction appropriately. These candidates took courses in multicultural 
diversity, growth and development, and special education in addition tothe 
field experiences in diverse environments. At least in one section during 
the foundations courses, candidates had several activities and one assessed 
product on international perspectives. A video, World 101 (Winfrey, 2002), 
and a response that required web-based research on a perspective from 
outside the United States were required. A world Culturegrams activity 
(Brigham Young University, 1990/2003) was used to explore international 
similarities and differences affecting effective, non-biased social interac- 
tions (Huber, personal communication, April 2004). Some of the candidates 
commented (Alagic, personal communication, April 2004) how they have 
many ideas in these areas to “connect” within instructional strategies 
classes, but the findings here do not confirm that. 
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Finally, in considering these questions, the team realized that one 
distractor might well have been considered as the accurate answer by 
many students. Question 29 was scored as inaccurate for students who 
chose the final option: The curriculum exemplifies diversity by covering 
avariety of countries/cultures (e.g., Spain, France, Dutch, Rome, Greece). 
First, the example blurs the difference between countries/cultures and 
languages, given the Dutch language is spoken in countries as diverse as 
Aruba, Belgium, Indonesia, Suriname, Zimbabwe, and South Africa 
(Levinson, 1998)—information that at least one cohort of candidates was 
aware because of two videos studied in the foundations course on 
diversity, Gumboots (Gumboot Dancers, 2000) and World 101 (Winfrey, 
2002). Asecond cause for confusion would have been a featured university 
diversity session on the culture of Cyprus that explored the Greek Cypriot 
and Turkish Cypriot differences. An entire class in this cohort attended 
that presentation. 


Discussion 


According to the findings reported here, it seems that the necessary 
transfer between course content and knowledge, skills, and dispositions 
is not occurring. What is necessary to “move” candidates from knowing 
about content from the knowledge bases for diversity, observing and 


teaching in diverse settings, to integrating and applying the information? 
What facilitates transfer? 

A lingering issue remains regarding the technological aspect of 
institutionalizing such broad-scale assessments. Recreating the instru- 
ments in electronic format presented a host of issues that the team could 
not have anticipated. A 4-page listing of problems noted early on in the 
electronic development included, for instance, “the SOS tool has prob- 
lems reading quotation marks because after quotes the tool left out the 
remaining text” (Alagic, personal communication, November 26, 2002). 
More specifically, though, an instrument as complex as the PBDS 
becomes a monster in electronic version. Candidates consistently com- 
plained about the lack of user-friendliness on this instrument. 

Candidates reported being “timed out” while completing the instru- 
ments. In addition, they reported doing the survey again to submit a 
completed survey. The impact of the frustration and the possible impact 
on responses have not been considered, but should be in future endeavors 
of this type. Distributing surveys directly to candidates and monitoring 
questions provides a different survey environment than asking them to 
log on to a computer (school, home, other, . . .) and respond to a set of 
assessments, surveys, and questionnaires. 





44 Multicultural/Diversity Outcomes 





On the web-based form, candidates were asked to identify their ethnic 
background. The directions were to check a box or enter the ethnic 
background in the blank field of the last answer. Candidates reported not 
understanding this instruction. 

The team remains committed to using a variety of assessments and to 
incorporating teaching/learning artifacts as well as performance components. 
That these components were not addressed in this aspect of the reporting is 
not to imply that they are not deemed important, even necessary. 

Many questions remain open. Looking back and deliberating over the 
construct map, a lingering issue remains in terms of simplification of 
instruments. For each program, an analysis of which questions on each 
instrument best address the targeted knowledge bases is a major step in 
collecting meaningful data to inform program effectiveness. 

Program-wide assessments, institutionally supported, and compre- 
hensively monitored, provide an opportunity to assess candidate knowl- 
edge, skills, and dispositions regarding multicultural/diversity topics and 
multicultural/global perspectives. Data gathered from these assess- 
ments can inform program development and revision, and provide 
specific details on program quality and success, but only when program 
faculty support the effort. In this study, the research team discovered just 
how important institutional support is and how devastating lack of 
comprehensive commitment can be to such explorations. A preliminary 
stage to this type of program-wide assessment appears to be the commit- 
ment of faculty and administration. Knowledge, skills, and dispositions 
regarding multicultural/diversity topics and multicultural/global per- 
spectives appear critical to certifying candidates in teacher education who 
will be successful in today’s classrooms. The Knowledge Bases for 
Diversity (Smith, 1991, 1998, 2001) provide the framework. Teacher 
educators need to make the commitment to incorporating and exploring 
these knowledge bases in their courses and then assessing the outcomes. 


Notes 


' This research was funded, in part, by a grant from the Multicultural/Diversity 
Outcomes Assessment Project, National Institute on Postsecondary Education, 
the United States Department of Education, Funds for the Improvement of Post- 
Secondary Education (FIPSE), and Emporia State University, Kansas. 
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Appendix 1 


Multicultural/Diversity Construct Map 
Knowledge Topics! KBDQ | MCCT-E |PBDS-E | 


Bases for 
Diversity 





| = | 
1. Foundations conceptual knowledge base 


of Multicultural | and principles; bias; 

Education family systems theory; 
cultural strengths and 
cultural histories; mc is | 
not only a minority issue; | 
monocultural education vs. | 
multicultural education; | 
language instruction; 
national identity; religious | 
pluralism; global interests | 


2. Sociocultural | motivation; child-rearing | 3, 11, 
Contexts of practices; family 16; 17; 
Human Growth/ | socialization; norms of 22, 24 
Development in | human growth and 
Mainstream and | development; ethnic 
Marginalized identity development; 
Ethnic and home culture/school 
Racial Cultures | culture; upbringing; 
segregation/integration 


3. Cultural and cultural learning styles; 
Cognitive learning environments 
Learning Style and classroom culture; 
Theory and mode of instruction; 
Research ability grouping; 
conscious inclusionary 
practices; customs and 
upbriging 
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Knowledge 
Bases for 
Diversity 


Topics! 


| KBDQ 


| MCCT-E | PBDS-E | MCR 





4. Language, 
Communication, 
and Interactional 
Styles 


5. Essential 
Elements of 
Cultures 


social interactions; cultural 
learning styles; ESL 
strategies, language 
acquisition (for both 
native English speakers 
and speakers of languages 
other than English); mode 
of instruction and language 


of instruction; incorporating | 


inclusionary practices 


elements of individual 
upbringing and collective 
culture and individual/ 
collective characteristics/ 
behaviors; motivation, 
diverse religions and 
languages, interest and 
openness to diversity, 
heritages, customs, and 
traditions; religious 
pluralism; global interests 


| 

| 

=r - T 
2, 8, 9, 


18 


1,9,13 
15, 21, 





-+ 





6. Principles of 
Culturally 
Responsive 
Teaching and 
Culturally 
Responsive 
Curriculum 
Development 


values; acculturation/ 
enculturation; integrated/ 
inclusive curriculum, 
multiple intelligence 
theory and learning styles, 
family teaching/learning 
styles/preferences; 
academic achievement; 
textbook bias; teacher 
expectations and experiential 


knowledge base with diverse 


cultures and choosing a 


diversity focus in teaching 


and language learning/ 
teaching; dealing with 
stereotypes; religious 
pluralism 





| 
| 
| 





7. Effective 
Strategies for 
Teaching 
Minority and 
Low Achieving 
Students 





family socialization and 
management; community 
resources; mode of 
instruction; cultural 
learning styles; 
interaction patterns; 
validating diverse 
backgrounds, experience, 
and upbringing 
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Knowledge 
Bases for 
Diversity 


Multicultural/Diversity Outcomes 


Topics’ 


KBDQ | 


MCCT-E 





8. Foundations 
of Racism 


9. Effects of 
Policy and 
Practice on 
Culture, Race, 
Class, Gender, 
and Other 
Categories of 
Diversity 


classism/funding/poverty, 
racism, sexism; 
segregation/integration; 
institutionalized racism/ 
classism; monocultural/ 
multicultural attitudes, 
policies, and practices; 
work ethic(s); religious 
pluralism 


classism/funding, racism, 
sexism; school choice, 
privatization, vouchers; 
ability grouping, 
tracking; dominance; 
segregation/desegregation/ 
integration; compensatory 
education, special 
education funding; 
interaction patterns; 
ability-level grouping; 
equal educational 
opportunity; religious 


differences and pluralism; 


policy and practice bias; 
proactive inclusion; 
national identity 


2, 1,9, 


12, 16, 
19, 20 





10. Culturally 
Responsive 
Diagnosis, 
Measurement, 
and Assessment 


11. Sociocultural 
Influences on 
Subject-Specific 
Learning 


_| 





assessments, attitude 
assessments, 
intelligence tests, 
achievement tests, 
aptitude tests; teacher 
expectations; non/ 


discriminatory evaluation; 


bias and segregation; 
tracking and ability-level 
grouping; recognizing 
cultural bias in 
assessment practices 


contributions of women 
and minorities 
(underrepresented groups); 
cultural histories and 
representations; diverse 
religions and languages; 
gender-fair instruction; 
inclusion/exclusion of 
social/learning practices 
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Knowledge 
Bases for 
Diversity 


Topics' | KBDQ 


MCCT-E | PBDS-E | 





12. Gender and 
Sexual 
Orientation 


contributions of women, 
case law, family 
organization, child-rearing 
practices, inclusive 
curriculum, gender bias, 
gay/lesbian rights, 
interaction patterns, 
gender-fair instruction, 
gender in professions 


yt; 
11, 25, 
2 


+ 
| 29 








13. Experiential 
Knowledge 


14. Foundations 
of Identifying 
and Teaching 
Students with 
Special Needs 


| first language instruction | 


+ : 
community resources and 


mentors from various 
cultures; experiential 
knowledge base with 
diverse cultures, accruing 
culturally different 
experiences, including 
interactions with different 
cultures; study abroad 


ESL’ strategies; person- 
first language; legislation; 
non/discriminatory 
evaluation; values/beliefs 
of student ownership; 
right to free and 
appropriate public 
education; funding; 
differentiated instruction; | 
inclusion; inappropriate 
referrals and over- 
representation of 
minorities/students of color; 








15. Foundations 
of International 
and Global 
Education 





. : , | 
diverse countries/cultures/ | 
| 


religions representation; | 
monocultural education | 
(versus multicultural | 
education); traditions; 
readiness and support for 
globai interest, cultural 
experience, and 
understanding; willingness 
to develop cultural interests, | 
openness to accruing 
cultural experiences, 
understanding and accepting) 
cultural differences; 
citizenship, nationality, 
and national identity 





| 2, 29, 30 











EE; 
12, 
15, 
18, 
19; 


| 26, 


28, 30 
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Notes for Appendix 1 


1 Topics were identified specific to the content of each statement or question 
on the individual instruments. Therefore, it would be inaccurate to determine that 
the topics listed are a comprehensive identification of the knowledge base to which 
they are attributed. Rather, these topics indicate the aspects of the knowledge 
base included on each instrument. 

2 English as Second Language (ESL) strategies are being included in this 
listing in consideration of students who need ESL, or similar support, as “special 
needs.” 
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Promoting Equity and Accountability 
in Multicultural Classrooms: 


Pre-Service Teachers Use Student Work to Evaluate 
the Impact of Standards-Based Instruction on Student Learning 


Donna E. McKibbens 
Wheelock College 


In the United States there has been a growing preoccupation with 
standardized testing as the measure of educational quality, particularly 
since the government focused on student achievement with publication 
of A Nation at Risk (NCEE, 1983). The implementation of No Child Left 
Behind Act has added high stakes to the national preoccupation with 
testing (NCLB, 2002). As public school students take more group admin- 
istered standardized tests each year, official communications imply that 
universal testing will assure equal educational access and opportunity to 
all students (NCLB). Others argue that universal testing raises serious 
questions related to equity (AERA, 2000; Dorn, 2003; FairTest, 1997; 
Meier, 2003; Orfield, 2004). 

Equity and accountability can be promoted in the nation’s classrooms 
through multiple means of assessment tied to the objectives of daily 
instruction and to the examination of student work (Banks, 1994; Darling- 
Hammond, 1997a, 2000, 2002a; Ladson-Billings, 1994; Meier 2003). Na- 
tional accreditation of teacher education programs that provide evidence 
of teacher competency in instruction and assessment is a research-based 
approach to foster student learning (Darling-Hammond 2000, 2002a). 


Current Focus on Student Achievement 
Measured by Test Score Gains 


Federal legislation requires annual state reports of test results for 
students and prospective teachers, for schools and school systems (NCLB 
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2002). Reporting systems provide the potential for aggregated test results 
by classroom, school, district, and state. Test results are increasingly used 
to determine promotion and graduation decisions for students, potential 
hiring and retention decisions for teachers and principals, performance 
ratings for pre-kindergarten through twelfth grade (P-12) schools, and 
budget decisions for districts (Meier, 2003; Partnerships, 2004). 

Standardized test results are used in many states as the primary 
measure of student readiness for promotion or graduation (Amrein & 
Berliner, 2002; Braun, 2004; Orfield, 2004). Yet current research indicates 
that high stakes testing may increase vulnerability to school failure and 
higher dropout rates for many of the nation’s children and youth. These 
findings apply particularly to students who represent more diverse racial, 
cultural, and language backgrounds (Amrein & Berliner, 2002; Braun, 
2004; Darling-Hammond, 2000; Meier, 2003, Orfield & Lee, 2005). 

As testing has become high stakes for teachers, principals, and school 
districts, debate increases over the ways in which some districts achieve 
rapid test score improvement. There is disagreement among researchers 
over methodology and sometimes over varying conclusions drawn from the 
same data (Braun, 2004). Variables that are often ignored in the analyses 
of improved test scores include increasing attrition rates among minority 
students, differences in whose scores are counted across states and 
districts, and access to test preparation (Amrein & Berliner, 2002; Braun). 

As districts and individual schools experience the consequences of 
lower test scores and disappointing score gains, drill for factual recall is 
often emphasized throughout the school day rather than engagement in 
broad and deep content mastery and critical thinking (Marchant & 
Paulson, 2005; Meier, 2003). Test preparation and coaching are necessary 
in the current educational climate, and these strategies may be effective 
in raising test scores. However, for many citizens test preparation drill 
and review are not an acceptable replacement for challenging curriculum 
and instruction that build knowledge and skills over time (Meier). It is 
unfortunate that the testing movement may create a backlash against 
accountability in general, placing at risk gains in student learning 
outcomes that result from standards based accountability. 


Promoting Equity and Accountability 


Equity and accountability are not mutually exclusive, and both 
should be carefully considered in the development of legislation or 
policies that influence educational practice. In contrast to extreme 
reliance on high stakes standardized tests, teachers who positively and 
consistently impact student learning tend to use multiple and varied 
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instructional and assessment strategies daily. A more classroom-based 
approach to assessment of student learning immediately impacts instruc- 
tion. This is a well-documented best practice among teachers who are 
committed to academic progress for all students, including diverse 
learners in increasingly multicultural urban and rural settings (Banks, 
1993; Darling-Hammond, 1995, 1999; Delpit, 1995; Flores-Gonzalez 2002; 
Ladson-Billings, 1994; Nieto, 1999a). 

While research and practice have shown that good teaching alone 
may not ensure a quality education to all citizens without extensive 
changes in social and economic policies at the national level (Rothstein, 
2004), effective teaching can promote learning and academic achieve- 
ment for all students (Banks 1993; Darling-Hammond, 1995, 1997b, 
2000). Effective teaching is defined by criteria such as subject content, 
knowledge of and work with diverse populations of students, pedagogical 
knowledge and skill to conduct ongoing assessment of student progress, 
and skillful use of P-12 standards (Banks, 1994; Cochran-Smith, 2004; 
Darling Hammond, 1999, 2000, 2002a). 


Educator Preparation Focuses on P-12 Student Learning 


Reliable and valid research demonstrates that rigorous content and 
performance-based standards can promote positive learning results 
(Banks, 1993; Darling-Hammond 1997a, 2000, 2002b). In response to 
research in teaching and learning, effective teaching has been redefined 
in terms of student learning results related to school based, state, or 
national standards (Darling-Hammond, 1997a, 1997b). Asaresult, teacher 
educators are expected to prepare pre-service teachers who focus on 
student learning and implement standards-based instruction, linking 
learning goals to daily instruction and assessment (Darling-Hammond 
1997a, 2002a, 2002b; McKibbens, 2000). 

In spring 2004, dozens of teacher educators gathered for a national 
conference on multicultural education and assessment. Eighteen partici- 
pants selected a workshop on the assessment of student learning in 
multicultural settings. Participants were asked to list the ways in which 
their pre-service teachers document the impact of instruction on student 
learning (McKibbens, 2004). In seven small groups, participants who 
represented eleven different institutions listed the evidence their stu- 
dents provide to demonstrate competency in the assessment of student 
learning following instruction. A summary of participant responses is 
provided in Appendix 1. 

One group of participants said most pre-service teachers include pre- 
tests and post-tests in their lesson plans while another spoke of video- 
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tapes of student teachers. Typical course assignments were listed such as 
journal entries, lesson plans, reflective essays, and student observations 
as evidence of the impact of teacher instruction on student learning. The 
eleven institutions represented were all involved in some way with the 
National Council for Accreditation of Teacher Education (NCATE) ac- 
creditation standards. Each institution was preparing for an initial 
accreditation or re-accreditation visit, and was seeking shared insight on 
ways to document their teacher candidates’ impact on student learning 
in diverse learning settings (McKibbens, 2004). 

NCATE is the national accrediting organization that has long set the 
standard for excellence in teacher preparation. NCATE performance- 
based standards include evidence that all teacher candidates from 
accredited institutions monitor and document the impact of their instruc- 
tion on student learning, as well as obtain passing scores on required 
state licensure examinations. Candidates must provide evidence of 
content mastery and pedagogical competency, to teach the nation’s P-12 
students effectively (NCATE Standards, 2000). 

It is predictable that in the shift to outcome based performance 
assessment, faculty members will revise some traditional pre-service 
teacher assignments to meet new standards, and challenges accompany 
the change process. One conference participant provided the example of 
aclassic videotape assignment that is now intended to provide data for the 
assessment of pre-service teacher impact on P-12 student learning. 
However, the videotaped lessons do not necessarily capture demonstra- 
tions of student learning related to lesson objectives. As teams presented 
and discussed the ways in which their pre-service teachers document 
their impact on student learning, it became clear that most of the 
evidence as currently collected would not provide adequate data for the 
new performance assessment standards. 

Another team of participants was in the final stage of preparation for 
a national accreditation visit. They indicated that their assessment 
system calls for aggregated data from samples of the P-12 student work 
that would illustrate the impact of pre-service teacher instruction on 
student learning. Lesson plans that include student work would be 
required for completion of student teaching at that institution in 2004- 
2005. However, workshop participants indicated that few of their pre- 
service teachers were currently given assignments that required them to 
collect and systematically analyze student work. 

At the close of the workshop session, participants identified the next 
steps their institutions might take to improve educator preparation 
related to assessment of student learning. They agreed that pre-service 
teachers need to go beyond the design of engaging lessons and the 
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collection of student work to illustrate that the lesson was taught. The 
systematic collection and analysis of student work in relation to instruc- 
tional goals and objectives should be required in several courses or 
experiences. Participants tended to agree that the knowledge and skills 
involved in assessment should be introduced early in preparation pro- 
grams and revisited in multiple classes. The self-reported information 
and resulting conclusions reached by the group of eighteen teacher 
educators at this assessment workshop parallel the transition to perfor- 
mance based assessment at Wheelock College, a small private institution 
known historically for educator preparation. 


Pre-Service Teacher Assessment 
of Student Learning at Wheelock College 


Educator preparation has been at the heart of the Wheelock College 
mission and work since its origin in Boston, Massachusetts, in the late 
1800s. The Education Division’s conceptual framework and vision are 
outlined on the institutional web site. Both documents reflect a commit- 
ment to accountability and to equity through high standards for program 
completion, the preparation of a diverse population of educators for 
multicultural P-12 settings, and the recruitment and retention of a 
competent and diverse higher education faculty. 

In the fall of 2000, Wheelock College was a pilot institution for the 
new NCATE performance-based standards. In preparation for meeting 
the new standards, former satisfaction surveys of graduates were re- 
vised, and a standards based survey study was designed and imple- 
mented. Graduates from 1997 through 1999 and their employers were 
asked to respond to survey questions aligned with selected indicators for 
the newly created Wheelock Education Division Standards. 

Survey results reflected very positive ratings, including the impact of 
graduates’ instruction on student learning (McKibbens, Kamii, & 
Crumpacker, 2000). Other documentation provided by the Education 
Division to meet new performance standards for re-accreditation included 
anecdotal data from student teaching portfolios and curriculum projects, 
lesson plans with assessment aims, and occasionally the illustration of 
student work attached to a lesson plan. In combination with the survey 
study of graduates and their employers, the evidence was adequate to meet 
the NCATE standards in the transitional pilot phase. The same evidence 
would not meet the fully implemented NCATE standards in 2005 because 
of over-reliance on evidence based on self-reporting, and because of the lack 
of a systematic plan prior to 2000 to demonstrate positive impact of pre- 
service teacher instruction on P-12 student learning. 
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Partially in response to the routine demands of re-accreditation, 
education faculty members at Wheelock College have worked more 
closely on assessment with each other, with arts and sciences faculty 
members, and with school site faculty. Assignments have been revised or 
created so that standards-based instruction and the analysis of P-12 
student work are expectations in several required courses. For example, 
the Elementary Department has expanded the requirements for a pre- 
practicum teaching experience to enable student teachers to assume 
more teaching responsibilities earlier and at a more advanced level 
during practicum (student teaching), including assessment of the impact 
of their instruction on P-12 student learning. 

Exit portfolios were prepared on a pilot basis by recent graduates, the 
first cohort of undergraduate elementary pre-service teachers who had 
completed a redesigned program with more rigorous state and institu- 
tional requirements. Review of the portfolio assessment data from the 
cohort reveals inconsistent documentation of pre-service teacher analy- 
sis of student work and little use of those data to improve student 
learning. The pilot cohort included 21 pre-service teachers who each 
wrote four reflective and analytical essays, one for each of four standards 
they selected from the seven Wheelock Division Standards. Essays were 
presented to and evaluated by a panel of three faculty members repre- 
senting education, arts and sciences, and school site faculties. Each essay 
required evidence of teacher competency related to the expectations 
described by the indicators for that standard. 

A majority of the pre-service teachers wrote extensively and often 
powerfully about their transformation in understanding of the social 
context of teaching and learning and the influences of culture on learning. 
They wrote about the importance of teaching effectively so that all 
students learn and achieve. Yet slightly more than half of the 21 
participants included any student work as evidence for at least one of 
their four essays. Less than one-fourth of the pre-service teachers chose 
to address Wheelock standard number five on assessment, and only one 
candidate presented strong evidence that utilized goals and objectives of 
an assignment selected or designed for P-12 students. 

A faculty work group reviewed the portfolio pilot data and the current 
undergraduate elementary program syllabi and identified several incon- 
sistencies in program curricula, particularly among different sections of 
the same required courses in the program. The work group has developed 
recommendations for review by the full Elementary Department, which 
includes college and school site faculty (Barron, Kamii, McKibbens, & 
Osinsky, 2004). Recommendations include more consistent assignments 
across required courses prior to student teaching. Key common assign- 
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ments across all sections of required courses should insure consistent 
documentation and analysis of student learning, and use of those data to 
revise instructional practice. Documentation of candidates’ attempts to 
improve instructional practices over time will be required along with 
related student work samples. 

Further faculty recommendations call for the assignment of written 
essays that require evidence of growing competency throughout their 
teacher preparation program and that are similar to the essays required 
for the exit portfolio. In this way pre-service program completion 
expectations would be more clear, and timely faculty support would be 
provided as the teachers-in-training practice, attain, and document 
increasingly advanced competency expectations prior to the final semes- 
ter of study. The recommended changes are intended to assure prepara- 
tion quality on a more consistent basis, which is a primary purpose of 
national accreditation for educator preparation. 


The Role of National Accreditation 
in Maintaining a Focus on Student Learning 


Higher expectations are continuously identified for educator prepa- 
ration; and when advanced knowledge and skill requirements are 
identified, they need to be implemented in all educator preparation 
programs. Each of the nation’s new and experienced teachers should 
know and practice effective teaching strategies that include continuous 
assessment, and the use of assessment data to improve instruction and 
learning outcomes. Meeting this goal would require more rigorous 
educator preparation standards for many institutions, as well as re- 
education and continuous professional development for many of the 
nation’s current teachers. 

Accomplishment of such a large goal at the national level requires 
national coordination. The requirement by all states of national accredita- 
tion for educator preparation institutions would not mean that the programs 
would lose their unique characteristics. It would mean implementation ofa 
common core of challenging expectations for a majority of the nation’s pre- 
service teachers, and more extensive faculty involvement in the develop- 
ment and implementation of appropriate institutional standards that would 
impact teaching and learning at the P-12 level through their student 
teachers and graduates. Mandating higher standards for all educator 
preparation programs nation-wide would be a far less risky practice than 
mandating arbitrary pass rates on standardized tests for all of the nation’s 
students without providing equity in learning opportunities, the description 
of policies that place a nation and its citizens at risk. 
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Two of the primary advantages of national accreditation are a 
rigorous peer review process and research-based standards that have 
been thoughtfully developed with the support of broad and diverse groups 
of professional colleagues. The second of six NCATE performance based 
standards requires an integrated assessment system for the education 
division or department. For example, passing scores on state-mandated 
teacher tests are a required component of an institution’s assessment 
system, but NCATE constituents and board representatives do not 
consider such tests to be adequate evidence that educators are prepared 
to promote learning for all students. The assessment system must 
include additional evidence that pre-service teachers plan and implement 
instruction that has a positive impact on student learning. 

The equally important NCATE standard four focuses on equity and 
diversity, with the expectation that accredited institutions will prepare 
educators to teach all students effectively. The NCATE standards also 
provide guidelines for fair and effective governance that give education 
faculty and administrators the responsibility and the authority to design 
policies and practices that improve educator preparation. High standards 
and high quality preparation on a consistent basis are worthy goals for 
any educational institution, and there are now two organizations that 
have federal recognition for accreditation of teacher education, NCATE 
and the Teacher Education Accreditation Council (TEAC) which also 
requires performance-based standards. 

The challenges of meeting high internal and external standards and 
working collaboratively toward more consistent and cohesive educator 
preparation programs can often be more easily accomplished if institu- 
tional decision making bodies and leaders are committed to national 
accreditation. The accreditation process is most effective when institu- 
tional leaders guide the teaching and learning community to welcome the 
high standards of a national peer review process. 

Instruction is often needed for education, arts and sciences, and 
school site faculties before they can provide seamless support for the 
achievement of high standards by pre-service teachers. Institutional and 
interdepartmental partnerships have long been promoted as an essential 
component of performance assessment and educator preparation excel- 
lence. Therefore, institutionally supported partnerships that are already 
in place might be a suitable structure for faculty development to support 
more extensive assessment education for pre-service teachers. 
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Use of Assessment Data to Improve Instruction and Learning, 
Program Revision, and Institutional Performance 


Pre-service teachers should be expected by the public to demonstrate 
their ability to write clear, measurable, standards-based goals and 
objectives that are linked to assessments of student learning. Systematic 
review and analysis of a range of student work samples from P-12 
students who struggle with content, students who make acceptable 
progress, and students who exceed expectations of mastery would serve 
pre-service teachers and their students well. The systematic collection 
and analysis of these data provide appropriate evidence for the teacher, 
the college or university faculty member, and the institution to use to 
demonstrate the impact of pre-service teacher instruction on student 
learning. When all pre-service teachers provide data of this type that can 
be aggregated, the results will provide vital information for improving 
programs and instruction for pre-service teachers and for their students 
(Elliott, 2003). The term accreditation is broadly used to signify the 
consistent public assurance of quality. Too many of the nation’s children, 
youth, and families have long been denied consistent quality that is an 
essential feature of educational equity (Darling-Hammond, 1997; Meier, 
2003; Orfield & Lee, 2005). Educational leaders are sounding the alarm 
that the nation is losing sight of the primary focus of educational reform 
which should be development, learning, and achievement for all stu- 
dents, not simply a race toward higher test scores for all (Darling- 
Hammond, 2002a; Meier, 2003; Nieto, 1999b). 

National accreditation of all educator preparation institutions would 
assure a resurgence of effective teacher assessment of student learning 
and higher quality public education on a more consistent basis. The 
accreditation process would not impose the unacceptable risks to students 
that are associated with assessment policies based on high stakes testing. 
Better answers to the nation’s questions about educational accountability 
are found in high standards that are equitably implemented in all 
classrooms and schools, including educator preparation institutions that 
prepare teachers for an increasingly multicultural national student body. 
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Appendix 1 


Teacher Educators Report on Candidate Evidence 
of the Impact of Their Instruction on Student Learning 





tT T 
| 


Group Number of | Number of | Candidate | Description 
Number Participants Institutions | Requirement! | of Evidence 
Represented | Provided 

by Candidates 
_t 
Group 1 : Teacher work 
samples; 
candidate 


reflections 





gl he 
unknown | Pre-post 
assessments in 
lesson plans 
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—_ i: 


2 
Group Number of Number of | Candidate Description 
Number Participants Institutions | Requirement of Evidence 
Represented] (see note 1) Provided 


| by Candidates 


Group B Weekly journals; 
Video of teaching 


Group , Video of teaching; 
Reflections; 
Pre-post tests; 
Observed 
student 
behaviors 








Supervisor 
observation; 
Journals; 
Intuition; 
Candidate 
reflection on 
student work; 
Student feedback 


Group 6 ‘ Candidate 
reflection; 
Lesson plans; 
Candidate 
dispositions; 
Student response 
to instruction 
(engagement, 
lack of discipline 
issues) 








Lesson plans and 
student work 
(04-05) 























Note 


' Note on candidate requirements, column 4. Candidate requirements at institutions 
represented by the seven groups fall into one of four categories, A-D: 


A. Candidates are not asked to document impact of instruction on student learning. 

B. Candidates are asked to demonstrate that they know how to document the impact 
of instruction on student learning 

C. Candidates are asked to document the impact of their instruction on student learning 
and candidates select various ways to meet this requirement. Faculty gives 
suggestions. 

D. Candidates are required to provide evidence that they systematically plan instruction, 
assess student learning related to instruction, and revise instruction based on the 
analysis of student learning. Evidence includes lesson plans and student work with 
reflective analysis and revision of instruction based on the analysis of student work. 
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A Global Worldview in the Teaching-Learning Process 


In 1756, Hector St. John de Crevecoeur wrote that in the American 
colonies individuals were being melted into a new race (see Huber, 2002, 
p. 1). The meltdown never occurred—and now more a mosaic than a 
melting pot—issues of cultural diversity and color permeate educational 
and social considerations in the U.S.A. 

In their most recent addition of Multicultural Education ina Plural- 
istic Society Donna M. Gollnick and Philip C. Chinn (2004) document the 
nation’s classroom diversity: 


Demographic data on birthrates and immigration indicate that there 
will be more Asian American, Latino (but not Cuban American), and 
African American children, but fewer children who are European Ameri- 
can. Students of color comprise more than one-third of the school 
population today. However, the race and sex of their teachers match 
neither the student population nor the general population; 86.5% of the 
teachers are white and 75% are female. By 2020 students of color will 
represent nearly half of the elementary and secondary population. 

It is not only ethnic and racial diversity that is challenging schools. . . . 
while small groups of Muslims, Hindus, Buddhists, and Sikhs have been in 
the country for many decades, only recently have they and their religions 
become highly visible. . . . The United States has not only become a 
multicultural nation, but has also become a multireligious society. (pp. 4-5) 


The continual approximation of culturally responsible pedagogy 
requires deeper levels of reflection and more culturally sensitive aware- 
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ness and language usage regarding the multicultural multireligious 
diversity of our students’ world. Pre-service and in-service pedagogists 
need to transfer knowledge bases about social justice and global interde- 
pendence into actions, inclusive of language, behaviors, and practices. 
But, how do educators plan and assess curriculum and instruction to 
support student learning, equity, social justice, and a global worldview in 
the teaching~learning process? 

This article explores strategies for critically analyzing home and 
school cultures, teacher and student cultures, and the elements of 
culture that inform such analyses. Evolved from critical multicultural 
education (McLaren, 2002) and framed on the “Knowledge Bases for 
Diversity in Teacher Education” (Smith, 1991, 1998, 2000-2001), these 
strategies require the participant to dig beneath surface veneers and 
challenge traditional explanations regarding the curriculum, instruc- 
tion, and teaching~learning process. As Peter McLaren (1998) explained: 


Why is a critical pedagogy so necessary? Part of the answer is that 
mainstream pedagogies generally avoid or attempt to obscure the ques- 
tion that should be central to education: What is the relationship between 
what we doin the classroom and our effort to build a better society. (p. xiv) 


A characteristic of multicultural, social reconstructionist, reflective 
teaching is the teacher’s focus both inwardly on his or her own practices 
and beliefs as well as outwardly on the social conditions in which these 
practices are situated (see Kemmis, 1985; Tabachnik & Zeichner, 1991). 


Both individual (self), as well as institutional (other) issues are thereby 
reviewed. 


Those who advocate a social reconstructionist view [of reflective teach- 
ing] certainly acknowledge the importance of subject matter, student 
understanding, research-based teaching techniques, and an emphasis 
on the students’ interests, thinking and development. Teachers who 
practice a multicultural, social reconstructionist version of reflective 
teaching view the substance of other versions through the lens of the 
larger society. Such teachers realize that without solid subject matter 
taught using appropriate effective instructional techniques, as well as 
curricula based on the needs, interests, talents, and learning styles of the 
children, students will not attain the knowledge base and skills neces- 
sary to become active participating members of society. Knowledge, 
skills, and personal development are not seen as individual ends but as 
essential components of a wider educational endeavor that helps stu- 
dents become active participants in improving our democratic society. 
A concern for issues of equity, justice, and human rights in both the 
teaching and the learning process serves as the backdrop for examining 
teaching and schooling. (Gillette, 2001) 
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One of the ways to focus on practices and beliefs is through the 
examination of one’s own culture and cultural understanding. 


Elements of Culture—Self 


A valid heuristic for knowledge, skills, and personal development is 
found in the consideration of the multi-faceted elements of culture (see 
Appendix A). Without engaging in ongoing critical reflection educators who 
study, teach, and assess lack full awareness that the students whom they 
teach perceive the world in radically different ways (see Gardner, 1983; 
Gilliland, 1995; Guild & Garger, 1985; Huber & Pewewardy, 1990a, 1990b; 
& Shade, 1989; for the knowledge base on multiple intelligences, modali- 
ties, and cultural styles). A learning process that engenders critical 
reflection on individual identity is one that requires participants to 
determine the significant aspects of their own cultural identity, locate 
iconic/symbolic/representative artifacts for each aspect, and then interpret 
the meaning. Huber (2002, pp. 17-25) has been asking students to prepare 
Culture Clip Exhibits for more than fifteen years. The guidelines for a 15- 
week semester course are found in Appendix B, though students have 
created Clips in 2-week intensive international courses, as well as by 
students enrolled in 4-week summer programs. Table 1 provides a rubric 
for the project exhibit and written captions. Appendix C represents 
examples of captions reflecting on self. 


Elements of Culture—Others 


Maclang-Vicencio (2003) articulated the need for culture-responsive 
curriculum that, ultimately accomplishes the broadest end of the con- 
tinuum, transdisciplinal that goes beyond the learning areas included in 
disciplinal and multidisciplinal to engage educators in “community-based 
action projects that provide opportunities to engage in individual and 
group action in the school and community” (p. 70). Appendix D represents 
examples of captions reflecting on self. 

Liberatory pedagogist Paulo Freire (1969/1989) explained gaining 
multiple awarenesses and accomplishing globally-interconnected, com- 
munity-based action: 


To be human is to engage in relationships with others and with the 
world. ... Men relate to their world in a critical way. They apprehend 
the objective data of their reality (as well as the ties that link one datum 
to another) through reflection—not by reflex, as do animals... . 
Transcending a single dimension, they reach back to yesterday, recog- 
nize today, and come upon tomorrow. (p. 3) 
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Eisner’s (1994) analysis of educational connoisseurship embellishes 
this view of the world: 


Todiscern what an event means requires an understanding of the context 
in which it occurs; that context requires not only some knowledge of the 
people involved and the circumstances within which the event occurs, but 
in many situations also something about the past, against which the 
particulars of the present can be placed. (p. 218) 


Based on Eisner’s principles of connoisseurship, each student/learner has 
the potential to become expert at seeing his or her world. 

The cultural awareness activity “Whose Culture?” provides a heuristic 
for participants to engage in critical reflection on components of self, 
student, home, school, and community culture (see Appendix E) to identify 
aspects of each that approximate or deter the accomplishment of teaching- 
learning that is culturally responsible and promotes equitable, just, global 
worldviews (see Gutek, 1997; Igoa, 1995, Townsend, Clarke, & Ainscow, 
1999). As Tabachnik and Zeichner (1991) detailed: “A social reconstructionist 
conception of reflective teaching has a democratic and emancipatory 
impulse and the focus of the teacher’s deliberations is upon substantive 
issues that raise instances of inequality and injustice within schooling and 
society for close scrutiny” (pp. 8-9). The “Whose Culture” experience of 
interviewing students and families and comparing the culture of the school 
with the culture of the home empowers pedagogists to better build 
relevancy and build a bridge to negotiate passage between home and school 
culture, a process Eugene Garcia (1994) identifies as scaffolding. 


Bridging Cultures 


The works of critical pedagogists committed to social justice and 
“humaneness’ (as extensively defined by Smith, 2004) must be “actioned as 
pedagogies and not merely focused on curriculum” (McMaster, cited in 
Huber, 2002, cover) and should include the works of Paulo Freire (1969/ 
1989); Peter McLaren (1993); G. Pritchy Smith (1998, 2000); Sonia Nieto 
(1992); Christine E. Sleeter and Carl] A. Grant (1999); Jacqueline Jordan 
Irvine (1990); Joseph Tobin, David Wu, and Dana Davidson (1989); Joel 
Spring (2000, 2004) in the forefront. John McMaster advocates, “One of the 
errors we have made in the past, I believe, is that we have failed to 
interrogate what culturally diverse pedagogies may look like... a primary 
tool for preparing beginning teachers, for vastly complex educational 
settings” (cover). What learning experiences facilitate the development of 
culturally sensitive and responsible pedagogists? How do educators facili- 
tate their students’ understanding of the cultural genocide that has been 
apart of United States education, what Joel Spring terms deculturalization? 
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Deculturalization is one aspect of a strange mixture of democratic 
thought an intolerance that permeates American history. The concept of 
deculturalization demonstrates how cultural prejudice, racism, and 
religious bigotry can be intertwined with democratic beliefs. 
Deculturalization combines education for democracy and political equality 
with cultural genocide. Deculturalization is the educational process of 
destroying a people’s culture and replacing it with a new culture. (p. 3; 
emphasis added by the original author) 


Perhaps Roger I. Simon (2000) has best detailed the need for a 
critically reflective approach to teaching about the cultural collisions and 
tragedies that have birthed the present moment: 


an approach to the past in relation to its absolute discontinuity from the 
time of the present . . . this form of remembrance holds to historical 
memories as traces of another’s time that may disrupt my own. On such 
terms, remembrance becomes a practice that supports a learning from 
the past that is a fresh cognizance or discovery that unsettles the very 
terms on which our understandings of ourselves and our world are based. 
In its most powerful form, such remembrance initiates forms of learning 
that shift and disrupt the present, opening one to new ways of perceiving, 
thinking, and acting. (p. 13) 


As then President of the World Council for Curriculum and Instruc- 
tion (WCCI), Larry Hufford (2003) reminded members: 


Globally speaking, these are dark times. We, as global citizens, face issues 
such as unilateral militarism, empire, state and stateless terrorism, 
global poverty, failed and failing states, narcotrafficking, trafficking in 
persons, child labor and child soldiers, gender equity, ecological insecurity, 
ethnic, racial and religious conflicts. ... A more just global community is 
not historically or theologically determined. I, along with others, must 
create it. That is, I must be involved in my community, locally, nationally, 
and/or globally, in an effort to daily model humaneness along with a 
personal commitment to justice and peace. As educators, it is not enough 
to teach peace. Each of us is obligated to be an exemplar, a role model of 
personal commitment to cross cultural/gender understanding, nonvio- 
lence, respect for an ecological balance and to confronting human created 
structural/silent violence that keeps people poor and oppressed. In short, 
educators must model civic engagement. (pp. 1-2) 


Whose Culture? 


The “Whose Culture?” field-based learning cultural awareness expe- 
rience (see Appendix E and Table 2) targets multiple outcomes, a primary 
one being the reflective immersion in a community, cultural activity that 
places the participant in an unfamiliar cultural setting, one in which as 
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many aspects of culture as possible are unknown to the participant. 
Consistently, participants report the mutual respect and regard these 
cross-cultural religious encounters engender. As Don Whitson (2004), an 
engineer then seeking alternative licensure and now teaching, reported: 


Master Thich Thien Hanh (Presiding Monk) at the Bu’u-Quang Buddhist 
Temple invited me to join the other participants for the afternoon meal 
that followed the ceremony in which we had just participated. Isat down 
on the floor in the traditional Vietnamese style and enjoyed a food/ 
culture extravaganza. More importantly, the experience was an event 
with prayer before and after eating. It was a meditation practice (silence 
was observed during eating) to fully engage in the act ofnourishment and 
all that it brings to the being and senses. It was a time to reflect and pay 
respect to the spirits. It was many things, but for me it was a time of 
acceptance, friendship, and internal re-evaluation from a people who 
spoke a different language, engaged in a different religion, enjoyed 
different meal customs, and looked and behaved a little differently than 
myself (a 50-ish white male whose experience with the Vietnamese 
culture prior to this event had been my military service in 1970). But, 
through all the differences, we enjoyed each other’s company, laughter, 
and a shared meal—both physical and spiritual food. We ended the 
experience with mutual respect, understanding each other a little better 
on our cultural awareness journey. (p. 3) 


Ruth Schott’s (2004) cultural awareness experience was, perhaps, 
one of the most challenging of her cohort. Independently, as a pre-service 
teacher candidate in her junior year of college, working without peers or 
team members, she immersed herself in a Muslim religious community 


and ceremony. Her reflections were enthusiastically shared with her 
colleagues: 


I attended Islamic Jummauh prayer at the Muslim Community Center 
in Wichita. Not only did I witness rituals and prayer services that were 
foreign to me, I also had the opportunity to experience what it would be 
like to be covered like Muslim women. A couple of very friendly Muslim 
women put the Hijab around my head completely covering my hair and 
then put a piece of lovely silk lavender cloth over the entire lower half of 
my body due to the fact I was wearing a knee-length skirt. Even though 
the Islamic religion has very distinct rules and rituals that the Muslim 
community must follow, I found myself in a very peaceful, calm, loving, 
family environment. The doors to the community center were left open 
so the wonderful warm breeze and air filled the prayer area. The prayer 
service was an entirely new experience for me. I especially enjoyed (what 
I would describe as) the beautiful, musical Arabic chanting used to recite 
the prayers. The fluid motion of the prayer service was very soothing. The 
man who led the prayer would chant in Arabic for a while, and then the 
people would bow. He would chant some more, then the people would 
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kneel with their heads and hands touching the floor, then they would sit, 
then kneel again, followed by only the men reciting what sounded like a 
brief, low musical reply back to the leader of the prayer. The people would 
then stand, bow, and kneel again during certain points in the prayer. This 
activity seemed to repeat itself over a ten-minute period. 

In my entire lifetime I have never experienced anything remotely like 
the Jammauh. Coming from an upper-middle-class Christian upbringing, 
there was absolutely no resemblance to any type of Christian worship 
service I was used to. In my experience of the Christian religion, it is 
customary to get dressed up for church, and I don’t think one would be 
allowed in the church service without shoes on. Men, women and families 
all worship together—there is no separation of the sexes. Nursery school 
and children’s bible classes are provided for the youngsters. There is no 
such thing as nursery school or children’s prayer school for Islamic youth 
during the Jammauh. Thechurches I have attended along with the church 
that I am attending now do not provide food after the service, and I have 
never in my life eaten an entire meal with my fingers! 

Even though the Jammauh was a completely foreign experience to 
me, I felt extremely comfortable and at peace during my time there. I was 
stunned to be welcomed with such warmth and hospitality by the people 
of the Muslim Community Center. 


The testimonies of Whitson and Schott resonate the experiences of 
their colleagues and uphold Hufford’s (2003) admonition that the Golden 
Rule exists in every religion. 


Most of us are persons of faith. Thus, we share a belief that each individual 
on earth has within a spark of the Divine. At the last WCCI Triennial in 
Madrid, Spain, participants were in shock as events of 9/11 unfolded. On 
the evening of 9/11 participants met to pray for understanding and a just, 
peaceful response. There were Hindu, Sikh, Buddhist, Jewish, Muslim, 
Christian, Baha’i prayers and chants. As persons of faith, each of us is 
called to oppose those of our particular faith who would turn our faith 
tradition into a movement of hatred and evil. Every major world religion 
has a Golden Rule and messages of cooperation, community and service 
to others; not simply charity, but a service that nonviolently challenges 
structural violence and structural sin. Every major world religion has a 
strong peace message. (p. 2; see, also, Hufford, 2000, pp. 180-181) 


Teachers who discover these common aspects of religious beliefs 
are better prepared to work effectively with the diversity of beliefs and 


religions represented in America’s classrooms. As Whitson (2004) 
concluded: 


It is necessary that the teacher’s perception, is just that, the teacher’s 
perception. We as educators have to craw] out of our skin and occasionally 
wear the skin of our students. I can never be enculturated beyond my own 
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individual culture, but I can be acculturated, acquiring deeper under- 
standings of other cultures. This is not free—not free from harassment, 
not free from the investment of resources, not free from challenges, and 
not free, in general, from negative arenas. But usually great things are 
not free. The knowledge base built in considering diverse populations from 
all perspectives will create a classroom that is better equipped and 
managed, able to facilitate instructional methods that are universally 
beneficial and that model an inclusive approach and attitude. . .. These 
additional cultural tools will enable the author/teacher to design and 
implement acurriculum and instruction that is promising for all students. 
Many threads connect us, but the one that is most common is that we are 
all human beings. One of the characteristics of humankind should be a 
sense of being humane and actively showing concern for others. Teachers 
being human and humane accomplish that. This journey is not about the 
teacher. This learning experience is for the most important participant in 
the educational journey, the student. (pp. 21-22) 


identifying the Parameters Defining Diversity 


What is needed is a culturally sensitive and responsible pedagogy for all 
students to maximize learning in American education. Culturally re- 
sponsible pedagogy is not color-bound or language-specific but sub- 
sumes all diversities to ensure sensitivity to and responsibility or all 
learners. (Huber, Kline, Bakken, & Clark, 1997b, p. 131). 


Tonya Huber, Frank Kline, Linda Bakken, and Fran Clark, faculty 
teaching the foundation courses at Wichita State University in 1991, 
adopted the holistic orientation of G. Pritchy Smith’s (1991) “Knowledge 
Bases for Diversity in Teacher Education” which provided the unifying 
framework for the three different courses and concurrent field experi- 
ence (see Table 3). The faculty updated the knowledge bases when they 
were published by the American Association of Colleges for Teacher 
Education as Common Sense about Uncommon Knowledge: The Knowl- 
edge Bases for Diversity (Smith, 1998) and again when Smith (2000) 
expanded the original 13 to 15 (see Table 4 for the current knowledge 
bases). As Smith explained, “the need for teachers to understand culture 
and understand the individual learner as a unique cultural being inti- 
mately connects avant-garde methods of critical inquiry with the knowl- 
edge bases for diversity in teacher education” (p. 27). 

Recognition of the knowledge bases has evolved into a pivotal aspect 
of each major assignment for these faculty and students. The applicable 
parameters must be identified on the cover sheet for each major project 
across the four courses in the Core I, foundations-level courses, Introduc- 
tion to Diversity: (a) Exceptionalities, (b) Cultural Issues, (c) Human 
Development, and (d) Field Experience. Such specific identification keeps 
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the parameters in the students’ focus throughout the field-based and 
learning experiences. 


Writing to Learn Culture 


Culturally Responsible Pedagogy in the teaching-learning process 
may require substantial rewriting, but, more importantly, substantial 
rethinking—the kind of thinking that requires time to revisit the deep 
wells of memory, personal experience, and personal belief in order to 
extract a clearer picture of the personal meanings the writer intends and 
the extrapolated meanings that readers can subsequently take away from 
the reading and apply to their own lives, circumstances, and work with 
curriculum and instruction. When properly guided, the thinking and 
reflecting process and subsequent application is central to learning, 
equity, and social justice. This is in addition to the time required to absorb 
and assimilate ideas uncovered initially in reading and study, unearthed 
during critical inquiry and, finally, embedded in the feedback and 
commentary from peers, faculty, and other readers. 

At the point that students pick up a pen or strike a key, they become 
very vulnerable. The editing/revising/ feedback process makes the writer 
even more vulnerable while issues of social justice and global diversity 
compound the issues. We are aware—as professors, editors, reviewers, 


authors, and lifelong learners ourselves—that writing is an extremely 
vulnerable process, especially when one is discussing something that is 
of deep personal meaning and significance. As Myers (1984) detailed: 


Writing to learn is not learning to write. But the emphasis of writing to 
learn is on learning content, not the writing skills themselves, although 
writing skills are likely to improve through practice. In this approach 
writing is a vehicle for clear and logical communication. It is process in 
which thinking—the organization, evaluation, and synthesis of knowl- 
edge—is essential. 


One of the major elements that distinguishes a piece of work as one 
of scholarly merit is that the writing of the scholar evidences not only an 
awareness and understanding of the choices inherent in the writing 
process, but also a willingness to hold those choices up for public scrutiny, 
and an ability to articulate, explicate, and defend the choices made with 
regard to both facets of the work. Doing so is evidence of deep engagement 
with the critical inquiry process and has the secondary effect of lending 
credibility to the work. 

Elliot Eisner (1994) explicated writing about education at a highly 
theoretical, deeply meaningful level, distinguishing educational criticism 
from educational connoisseurship, the first being the art of disclosure, 
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the latter being the art of appreciation with both requiring a great deal 
of classroom experience (pp. 215-216), 


What is involved in the development of educational connoisseurship is, 
first, the opportunity to attend to happenings of educational life in a 
focused, sensitive, and conscious way. Second, it requires the opportunity 
to compare such happenings, to discuss what one sees so that perceptions 
can be refined, to identify events not previously perceived, and to 
integrate and appraise what has been seen. (p. 217) 


The social reconstructionist needs this depth of experience and 
focused critical reflection in the process of seeing self as foundational to 
developing and assessing culturally responsible pedagogy in reflective, 
pre-service and in-service teacher work. Understanding self, the teacher 
is more effectively positioned to understand the individual learners’ 
selves. Focused reflection empowers culturally responsible pedagogists 
to become aware of what they had previously been unable to see. 
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Table 1 
Culture Clips Rubric for Feedback 
Exemplary Target | Accomplished || NotAccomplished 





Developed comprehensive| Developed | Provided 10-11 Provided captions 
analysis of 14-15 comprehensive | captioned clips and/or clips 

aspects of individual analysis of 12-13 | 
culture in captioned captioned 
clips/artifacts clips/artifacts 





: : = - - 
Caption statements | Included in each |Communicated | Communicated 
. ~ . | . . a 
include 5 clearly caption statement | important information 
labeled sections: (a) a title, | information as isolated pieces 


(a) a definitive or (b) a date | in caption 
representative title, defining the clip, | format 
(b) the date defining (c) the elements 
the clip, (c) the elements | of culture, 

of culture, (d) a (d) a reflective 
reflective statement statement, and 
on the significance of (e) references 
the clip to individual 
culture, and (e) references 


Clips clearly identified Clips included at | Clips included | Clips included 
sources from each of the | least 5 of the | at least 4 of the | education topics 
following: newspaper(s)/ | following: | following: 
magazines, journal(s), newspapers, | newspapers, 
web source(s), 3-dimensional| magazines, | magazines, 
object(s), photo(s/picture(s), | internet sources, | internet sources, 
radio/television/film; 3-dimensional objects! 3-dimensional 
and included perspectives/ | photos/pictures, | objects, photos/ 
sources from multiple race/ | television/film; pictures, 
ethnic, gender, religious | and included television/film; 
groups, local, national perspectives/sources | and included 
and international from multiple race/ | multiple 
ethnic, gender, perspectives 
religious groups 
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| Exemplary Target [Accomplished NotAccomplished 


Provided 1-2 specific Provided at least | Provided at least | Provided 
references for each one specific one specific citations 
clip/caption with at least | reference for reference for | or references 
15 different citations each clip/caption | each clip/caption 
of required readings with at least 10 |withatleast7 | 
and viewings (sources) | different citations | different citations 
along with additional of required of readings 
references to the readings and land viewings 
professional knowledge | viewings 
base 
g ; : 4 : a 
Applied college-level, Applied | Applied Presented 
word-processed writing | college-level, college-level hand-written 
standards in caption word-processed | writing project or 
component employing writing standards| standards in unprofessional 
unbiased language as in caption presenting organization 
a critically reflective component word-processed | of material 
pedagogist approximating captions 
unbiased language 
in critical reflection 




















Note: For this assignment, the rubric categories are weighted as follows: 
Exemplary=20, Target=15, Acceptable=12.5, Unacceptable=11. 

If a component is missing, the score is zero. 

Evaluation of ~~»... Metal Parmts: _ 


Table 2 


Whose Culture? Field Experience Requirement 





eee i 
Exemplary Proficient Acceptable | NotAcceptable 


Description | Detailed Description of Description | Consideration 
of Cultural | description the event, of the (a) of event 
Awareness | of the event, including (a) event, (b) description and 
Event including (a) date, location, purpose of j|explanation of 
date, location, and name of event, (c) _| how this activity 
and name of activity, (b) participants |introduced you 
activity, (b) purpose of event,| in the event, |to a cultural 
purpose of event,|(c) participants (d) how this | group 

(c) participants in| in the event, (d) | activity different 

the event, (d) explanation of introduced |from your own 
explanation of how this activity | you toa 
| how this activity | introduced you | cultural group 
introduced you to| to a cultural different 
a cultural group | group different | from your 
different from from your own | own 

your own 
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Analysis 
of 
Elements 
of Culture 


es 
Curriculum| Detailed and 


Resource 
Evaluation 


School 
Environment 
Evaluation 


Family 
and Home 
Culture 


Exemplary 


Interpretation 
of more than 
10 elements 

of culture, 
including, at 
least 2 surface 
and 8 deep, 
with supporting 
documentation 
(e.g., notes, 
programs, photos, 
artifacts) 


documented 
responses to all 
required 
curriculum 
resource 
evaluation 
components 


Detailed and 
documented 
responses to 
all school 

environment 
components 


Detailed and 
documented 
responses to 
all family and 
home culture 
components 


Proficient 


+ 
| 
| 
| 
T 


Interpretation 
of at least 10 
elements of 
culture, 
including 2 | 
surface and 8 
deep with 
documentation 
(e.g., notes, 
programs, 
photos, 


artifacts) | 


Documented [ 
responses to 
curriculum 
resource | 
evaluation 


| 
components | 
| 


Documented 
responses to 
all school 
environment 
components 


| 


| 


- + 


Documented 
responses to 
all of the 

family and home 
culture 
components 


Acceptable 


Application 
of at least 
10 elements 
of culture 


Documented 
responses to 
the majority 


of curriculum 


resource 
evaluation 
components 


Documented 
responses 

to the majority 
of school 
environment 
components 


Documented 
responses to 


| the majority of 


family and 
home culture 
components 


T 
NotAcceptable 


Consideration 
lof elements 
|of culture 


Cursory 
consideration 
of components 


Cursory 
|consideration 
of components 


Cursory 
| consideration 
of components 








Reflection 
and 
Analysis 
of Elements 
of Home 
and School 
Cultures 





Specific 
identification 
and analysis of 
the intersecting 
elements of home 
and school cultures, 
including visual 
analysis and 
integration of 
major core 
readings 





Specific 
identification of 
the intersecting | 
elements of home 

and school 
cultures, including} 
visual analysis 
and references 
to major class 

readings 


| 
—7 
| 





Identification 
of the 
intersecting 
elements of 
home and 
school 
cultures 
including 
visual 
analysis 


Cursory 
consideration 
lof elements 

of culture and 
implications 
regarding 

| professional 
|knowledge base 
development 














Assessing Culturally Responsible Pedagogy 





Application 
of APA 
Writing 
Guidelines 


Exemplary 


The entire 
document is 


word processed 


and includes 
headers and 


— 


+ 


Proficient 


The document 
is word 
processed and 


includes headers | 


and pagination; 


Acceptable 


The 
document 
is word 
processed 
and includes 


NotAcceptable 


Inconsistent 
application of 
professional 
writing 
standards 


headers and 
pagination; 
professional 
grammar, 
spelling, 
punctuation 
and word 
usage; 
including 
5 | 
double spacing 


consistent 
pagination; 
professional 
grammar, 
spelling, 
punctuation, 
and word usage; 
consistent with 
APA guidelines, 
including double 
spacing, in-text and in-text 
citations, and citations 
references to 
major core 

readings | 


professional 
grammar, 
spelling, 

| punctuation, 
and word usage; 
including 
double spacing, 
in-text citations, 
and references | 
to major class 
readings 























1. “ 1 L 

Note: For this assignment, the rubric categories are weighted as follows: 
Exemplary=20, Proficient=15, Acceptable=10, Not Acceptable=0. 

A total rubric score of 100 or above with no aspect scored as zero is required. 

An exemplary submission includes: Title page and paper with references and support 
documentation, a copy of the FER requirements (from the Road Map) goals and 
parameters analysis, evidence of approval, and this rubric. 

Approval of Activity___ 


Date Approved __ 
Name 


Date Submitted ___ 


Table 3 
Smith’s Knowledge Bases for Diversity ' 


PARAMETERS GUIDING PRINCIPLES 


I. Foundations of 


a review of international, legal, and historical, theory, 
Multicultural Education 


research, and practice undergird the study and practice 
of multiculturalism 

II. Sociocultural Contexts 
of Human Growth and 
Development in 
Marginalized Ethnic 

and Racial Cultures 


child-rearing, social interaction, gender role identification, 
parenting, responsibility, cultural/developmental scripts, 
and other psycho-socio-cultural patterns affect the way 
people learn and respond to reading 


III. Cultural and Cognitive 
Learning Style Theory 
and Research 


cultural cognitive styles and multiple intelligences 
research, combined with a thorough understanding of 
learning style theory, enables the teacher to maximize 
instruction 


IV. Language, 
Communication, and 
Interactional Styles 


recognizing cultural styles related to speech patterns, 
verbal and nonverbal interactions, and inter-relationship 
patterns 
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PARAMETERS 


V. Essential Elements 
of Culture 


VI. Principles of Culturally 
Responsive Teaching and 
Culturally Responsive 

Curriculum Development 


VII. Effective Strategies 


VIII. Foundations of Racism 


IX. Effects of Policy and 
Practice on Culture, Race, 
Class, Gender, and Other 
Categories of Diversity 


X. Culturally Responsive 
Diagnosis, Measurement, 
and Assessment 


XI. Socio-cultural Influences 
in Subject-specific Learning 
XII. Gender and Sexual 
Orientation 


XIII. Experiential 
Knowledge 


XIV. Foundations of 
Identifying and Teaching 
Special Needs Students 


XV. Foundations of 


International and 
Global Education 


GUIDING PRINCIPLES 


studying ancient through contemporary history of 
cultures highlights common features and distinctive 
differences of deep culture characteristics that help the 
educator better understand the individual child or student 


analyzing the language, concepts, principles, practices, 
theory and research on teaching responsive to, and 
responsible for cultural issues in the explicit, implicit, and 
null curricula including cultural synchronicity, congruity, 
continuity, correspondence and cultural scripts 


strategies, policy, and practice can produce positive effects 
for previously low-achieving students 


issues of racism, slavery, genocide, prejudice, bias, 
stereotyping, and discrimination and their effects on 
micro-and macrocultures 


determining the impact of the differential effects of policy 
and practices on race, class, gender, and culture regarding 
such issues as teacher expectations, ability grouping and 
curriculum tracking studies, desegregation and 
integration studies, discipline, and suspension/expulsion 
and drop out/push out factors 


replacing of the traditional view of intelligence as a 
physical substance, a measurable, entity, and a subsequent 
focus on measurable, easily quantifiable constructs 
focusing on linguistic and logical-mathematical 
intelligences and culture-specific norms 


planning with recognition of cultural influences on specific 
school subjects 


knowledge about gender differences and the impact 
of sexual orientations, both the students’ own and those 
of family members, on students 


lived and supervised clinical experiences that include 
personal cross-cultural and multicultural lifestyle 
experiences and supervised demonstration of culturally 
responsive teaching in clinical school settings with 
culturally diverse student populations and professional 
knowledge about how teachers teach effectively and 
responsibly in multicultural classrooms representing 
diversity issues, particularly from action research, 
ethnography, case studies, and educational anthropology 


preparation of regular education teachers to identify and 
respond sensitively and appropriately to students’ special 
needs, an aspect of teacher education that typically occurs 
only for those candidates certified as special education 


analyzing global and international education beyond 
introductory comparative education which often 
contributes to the provincialism of teachers in the United 
States 
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1While the parameters define and organize the knowledge bases for developing culturally 
responsible pedagogy, they transcend the theoretical to visibly emerge in curriculum 
development. Adapted from G. P. Smith, 1991, 1998, 2001 (Huber, 2002, p. 42). 


Table 4 


Parameters of the Knowledge Bases for Diversity in Teacher Education by Course 





Parameters of the Knowledge Base CF FE? HD* FE‘ 





1. Foundations of multicultural education X X 





2. Sociocultural contexts of human growth xX 
and development in marginalized ethnic 
and racial cultures 


3. Cultural and cognitive learning style 
theory and research 





4. Language, communication, and interaction } 
styles 





5. Essential elements of cultures 





6. Principles of culturally responsive 
teaching and culturally responsive 
curriculum development 





7. Effective strategies 





8. Foundations of racism 





9. Effects of policy and practice on culture, 
race, class, gender, and other categories of 
diversity 





10. Culturally responsive diagnosis, 
measurement, and assessment 





11. Socio-cultural influences in 
subject-specific learning 





12. Gender and sexual orientation 





13. Experiential knowledge 





14. Foundations of identifying and teaching 
special needs students 





15. Foundations of international and 
global education 





1CI = Cultural Issues; 7E = Exceptionalities; 
3HD = Human Development; ‘FE = Field Experience 
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Appendix A 
Elements of Culture! 
SURFACE CULTURE 


(observable) 
. Arts (traditional and contemporary music, visual and 
performing arts, and drama) 
. Folklore (folk tales, legends, and oral history) 
. Food (food and culinary contributions) 
. Heroes/Personalities (historical, contemporary, and local figures) 
. History (historical and humanitarian contributions, and social 
and political movements) 
. Holidays (patriotic holidays, religious observances, and 
personal rites and celebrations) 


DEEP CULTURE 


. Ceremony and Celebration (what a person is to say and do on particular occasions) 
A. What is the purpose (e.g., political, seasonal, religious, didactic?) 
B. Which are especially important for children and why? 
C. What cultural values do they intend to inculcate? 
D. What aspects of socialization/enculturation do they further? 


. Communication 

A What languages and varieties of each language are used in the community? 
By whom? When? Where? For what purpose? 

B. Which varieties are written, and how widespread is knowledge of written forms? 

C. What are the characteristics of “speaking well,” and how do these relate to age, 
sex, context, or other social factors? What are the criteria for “correctness”? 

D. What roles, attitudes, or personality traits are associated with particular ways 
of speaking? 

E. What range is considered “normal” speech behavior? What is considered a speech 
defect? 

F. Is learning a language a source of pride? Is developing bilingual competence 
considered an advantage or a handicap? 

G. What is the functionality of the native language in the workplace or larger 
environment? 

H. What gesture or postures have special significance or may be considered 
objectionable? What meaning is attached to direct eye contact? To eye 
avoidance? 

I. Who may talk to whom? When? Where? About what? 


3. Courtship and Marriage (attitudes toward dating, marriage, and raising a family) 


4. Eating Customs and Rules 

A. What is eaten; in what order; and how often? 

B. What foods are favorites; what taboo; what typical? 

C. What rules are observed during meals regarding age and sex roles within the 
family, the order of serving, eating, utensils used and appropriate verbal 
formulas (e.g., how, and if, one may request, refuse, or thank)? 

D. What social obligations are there with regard to food giving, preparation, 
reciprocity, and honoring people? 

E. What relation does food have to health? What medicinal uses are made of food, 
or categories of food? 
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F. What are the taboos or prescriptions associated with the handling, offering, or 
discarding of food? 


5. Education 

A. What is the purpose of education? 

B. What kinds of learning are favored (e.g., rote, inductive)? 

C. What methods of teaching and learning are used at home (e.g., modeling and 
imitation, didactic stories and proverbs, direct verbal instruction)? 

D. Do methods of teaching and learning vary with recognized stages in the life cycle; 
with the setting; or according to what is being taught or learned? 

. What is the role of language in learning and teaching? 

. Is it appropriate for students to ask questions or to volunteer information? If so, 
what behavior signals this? If not, what negative attitudes may it engender? 

G. What constitutes a positive response by a teacher to a student? By a student to 
a teacher? 

H. How many years is considered normal for children to go to school? 

I. Are there different expectations by parents, teachers, and students with respect 
to different groups; in different subjects; or for boys vs. girls? 


6. Aesthetics (the beautiful things of culture: literature, music, dance, art, architecture, 
and how they are enjoyed) 

A. What is considered beautiful? 

B. What are important works of art? Artists? Buildings? 

C. What dances are performed at celebrations? 


7. Ethics and Discipline (how a person learns and practices honesty, fair play, principles, 
moral thought, etc.) 


8. Family Ties (how a person feels toward his or her family, friends, classmates, 
roommates, and others) 
A. Who is in a family? Who among these (or others) live in one house? 
B. What is the hierarchy of authority in the family? 
C. What are the rights and responsibilities of each family member? Do children have 
an obligation to work or to help the family? 
D. What are the functions and obligations of the family in the larger social unit? 
To the school? To its individual members? 
E. What is the relative importance of an individual family member vs. the family 
as a whole? What is the degree of solidarity or cohesiveness in the family? 


9. Health and Medicine (how a person reacts to sickness, death, soundness of mind and 
body, medicine, etc.) 
A. Who or what is believed to cause illness or death (i.e., the germ theory vs. the 
supernatural or other causes)? 
B. Who or what is responsible for curing? 
C. How are specific illnesses treated? To what extent do individuals utilize or accept 
modern medical practices by doctors and other health professionals? 
D. What beliefs, taboos, and practices are associated with menstruation and the 
onset of puberty? 
E. What are beliefs regarding conception and childbirth? 
F. What beliefs or practices are there with regard to bodily hygiene (e.g., bathing 
frequency and purpose)? 
G. If a student were involved in an accident at school, would any of the common 
first aid practices be unacceptable? 


10. History, Traditions, and Folk Myths (attitudes toward heroes, traditional stories, 
legendary characters, superstitions, etc.) 
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. What individuals and events in history are a source of pride for the group? 
. To what extent is knowledge of the group’s history preserved? 
’. In what forms and in what ways is it passed on? 
. To what extent is there a literate tradition of the history of the group (e.g., written 
history, and knowledge of written history within the group itself)? 
. To what extent are traditions and historical events reflected in aphorism and 
proverbs? 
. Do any ceremonies or festive occasions re-enact historical events? 
. How and to what extent does the group’s knowledge of history coincide with or 
depart from scientific theories of reaction, evolution, and historical development? 
H. To what extent does the group in the United States identify with the history and 
traditions of their country of origin? 
I. What changes have taken place in the country of origin since the group or 
individual emigrated? 
J. For what reasons and under what circumstances did the group or individuals 
come to the United States (or did the United States come to them)? 


11. Kinesics and Interpersonal Relationships (forms of non-verbal communication or 
reinforced speech, such as the use of the eyes, the hands, and the body) 
A. Is language competence a requirement or qualification for group membership? 
B. How do people greet each other? What forms of address are used between people 
in various roles? 
>. Do girls work and interact with boys? Is it proper? 
. How is deference shown? 
. How are insults expressed? 
. Who may disagree with whom? Under what circumstances? 
G. Are mitigating forms used? 


12. Grooming and Presence (the cultural differences in personal behavior and appear- 
ance, such as laughter, smile, voice quality, gait, poise, hair style, cosmetics, dress, etc.) 
A. What clothing is typical? What is worn for special occasions? What seasonal 
differences are considered appropriate? 
B. What significance does dress have for group identity? 
’. How does dress differ for age, sex, and social class? 
. What restrictions are imposed for modesty (e.g., can girls wear shorts, or shower 
in the gym)? 
. What is the concept of beauty, or attractiveness? How important is physical 
appearance in the culture? What characteristics are most valued? 
F. What constitutes a compliment and what form should it take (e.g., in traditional 
Latin American culture, telling a woman she is getting fat is a compliment)? 
G. Does the color of dress have symbolic significance (e.g., black vs. white for 
mourning)? 
13. Life Cycle 
A. What are the criteria for the definition of stages, periods, or transitions in life? 
B. What are attitudes, expectations, and behaviors toward individuals at different 
stages in the life cycle? 
C. What behaviors are appropriate or unacceptable for children of various ages? 
How might these conflict with behaviors taught or encouraged in the school? 
D. How is language related to the life cycle? 
E. How is the age of children computed? What commemoration is made of the child’s 
birth (if any) and when? 


14. Natural Phenomena 
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15. Ownership (attitudes toward ownership of property, individual rights, localities, beliefs, etc.) 


16. Precedence (what are accepted manners toward older persons, peers, and younger 
persons) 
A. Who has authority over whom? To what extent can one person’s will be imposed 
on another? By what means? 
B. How is the behavior of children traditionally controlled, to what extent, and in 
what domains? 


17. Rewards and Privileges (attitudes toward motivation, merit, achievement, service, 
social position, etc.) 


18. Rights and Duties (attitudes toward personal obligations, voting, taxes, military 
service, legal rights, personal demands, etc.) 


19. Religion (attitudes toward the divine and the supernatural and how they affect a 
person’s thoughts and actions) 
A. What is considered sacred and what secular? 
B. What religious rules and authority are recognized in the community? 
C. What is the role of children in religious practices? What are they supposed to 
know or not to know about the religion? 
D. What should an outsider not know, or not acknowledge knowing? 
E. What taboos are there? What should not be discussed in school; what questions 
should not be asked; what student behaviors should not be required? 
F. Are there any external signs of participation in religious rituals (e.g., ashes, dress, 
markings)? 
G. Are dietary restrictions to be observed, including fasting on particular occasions? 
Are there any prescribed religious procedures or forms of participation if there 
is a death in the family? What taboos are associated with death and the dead? 


20. Roles (what positions in the social grouping are available to members) 


21. Sex Roles (how a person views, understands, and relates to members of the opposite 
sex and what deviations are allowed and expected) 


22. Space and Proxemics (attitudes toward self and land; the accepted distances between 
individuals) 
A. Is there a seasonal organization of work or other activities? 
B. What is acceptable presence or grouping of individuals (e.g., do children stay with 
adults and listen or go outside)? 
C. How do individuals organize themselves spatially in groups (e.g., in rows, circles, 
around tables, on the floor, in the middle of the room, around its circumference)? 
D. What is the organization of the home (e.g., areas allotted to children or open to 
children, appropriate activities in various areas of the home)? 
E. What geo-spatial concepts, understandings, and beliefs exist in the group or are 
known to individuals? 
F. What is the knowledge and significance of cardinal directions (North, South, 
East, West)? At what age are these concepts acquired? 
G. What significance is associated with different directions or places (e.g., heaven 
is up, people are buried facing west)? 


23. Subsistence (attitudes about providing for oneself, the young, and the old, and who 
protects whom) 


24. Taboos (attitudes and beliefs about doing things against culturally accepted patterns) 
A. Are particular behavioral prescriptions or taboos associated with the seasons 
(e.g., not singing certain songs in the summertime or a snake will bite, not 

eating oysters when there is an R in the name of the month)? 
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25. Time (attitudes toward being early, on time, or late) 
A. What beliefs or values are associated with concepts of time? How important is 
punctuality? Speed of performance when taking a test? 
B. Is control or prescriptive organization of children’s time required (e.g., must 
homework be done before watching TV, is bedtime a scheduled event)? 
C. Is time a monochromic or polychromic concept? 


26. Values (attitudes toward freedom, education, cleanliness, cruelty, crime, etc.) 


27. Work and Play (attitudes toward the relationships between work and play or free 
time) 


‘Adapted from Gonzales, 1978. 


Appendix B 
Culture Clips Guidelines 


Class 1 (or Day or Week 1) 

1. Study the elements of surface culture (see Figure 1). 

2. Reflect on meaningful aspects of your culture for each of the 6 elements identified 
as surface culture. 

Due Class 2 

3. Place a picture of yourself (if culturally appropriate) in the center of a piece of paper/ 
poster (at least 11”x17”) or on a technologically generated web (using legal size paper 
or larger). Include your name on this visual representation. 

4. Select at least one clip (artifact/symbol/icon/representation/ picture) to represent the 
surface element of food and arrange/attach the clip on your exhibit. 

5. Write a caption for your clip. Each caption must include at least the following 4 clearly 
labeled sections: (a) a definitive or representative title, (b) the date defining the 
clip—not the date it was captioned, (c) the element of culture, and (d) critical 
reflection—interpretation of possible implications for your role as a culturally 
sensitive and responsible educator—this separates student activity from the 
behavior of a reflective pedagogist who seeks opportunities to grow professionally. 
At least one specific reference to the knowledge base is required for each caption. 
Reference the citation and begin a reference page. 

Due Class 3 

6. Repeat steps 4-5 to create a clip and caption for a holiday. Add the necessary 
information to your reference list and continue to do so with each new entry. 

7. Using technological skills, create a cultural identity circle that considers at least the 
following microcultural group identifiers for yourself: ethnicity, race, gender, 
language, religion, creed, age, exceptionalities, sexual orientation and preference, 
socioeconomics, regional/geographic origins and connections. Base your analysis 
on the present and include percentages that equate to 100% of your identity. An 
example of a cultural identity circle is provided by Gollnick and Chinn (2002, p. 21) 
in Muiticultural Education in a Pluralistic Society (6% ed.). 

Due Class 4 

8. Repeat steps 4-5 to create a clip and caption for two elements of surface culture: heroes/ 
personalities and history. 

Due Class 5 

9. Repeat steps 4-5 to create a clip and caption for the remaining two elements of surface 
culture: arts and folklore. 

Due Class 6 

10. Submit the 6 surface elements of culture captions. Clips should not be submitted. 
These will be returned with feedback. 
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Due Class 7 

11. Discussion of caption feedback. 

Due Class 8 

12. Repeat steps 4-5 to create a clip and caption for a self-selected deep element of culture. 

Classes 9-14 

13. Develop comprehensive analysis of 10 elements of deep culture in captioned clips. 
Insure that captions include application of program content and parameters of the 
knowledge bases for diversity. 

Due Class 14 

14. Culture Clips Exhibit—Work collaboratively and professionally during the exhibit 
to communicate effectively using meaningful display of artifacts/clips, a complete 
caption for each clip, a cultural identity circle, and a current photo (if culturally 
appropriate). Exhibits are enriched by samples of your food element of culture or 
by other experiential aspects or take-aways for the guests who peruse your exhibit. 


Appendix C 
Captions Reflecting on Self 
Clay Burell, High School ESOL/Humanities Teacher, Shanghai American School, China 
From Soldier to Peacemaker: Learning the Enemy’s Language 


Artifact: A Personally-Written Note in Arabic 

Dates: 1996-98 

Surface Culture: Arabs as the enemy 

Deep Culture: Language; Culture; Religion; Society; Values; Proxemics; Diet 
Reflection: 

I graduated with a B.A. in Humanities (Eurocentric) in 1996. Though a liberal secular 
humanist at heart, I had experienced increasing disenchantment in my final university 
years with the radical, theory-based dogmatism (for so it seemed to me) of my very left- 
wing academy: besides the confrontational, shrill, divisive, and often uncivil tactics used 
by the radical community—all of which I found aversive—I also harbored skepticism 
toward the theoretical basis of the ‘knowledge’ I was taught by an overwhelming white, 
middle class, educationally sheltered faculty. I wanted direct experience of life as a 
standard of comparison with the theories dominating my education. I was particularly 
alienated by the academic attack on the traditional literary canon, which I had devotedly 
studied and treasured for the prior fifteen years (an unwitting subject of/to the tradition- 
alist philosophy of pedagogical valid curriculum). Suddenly this new breed of professors 
seemed determined to demote Homer and Shakespeare and all my other heroes to 
politically suspect or simply irrelevant authors. I was so aghast at the prospect of becoming 
a professor who loved this canon among an intellectual community that didn’t that I 
abandoned my plans to earn my doctorate in literature and become a professor. 

I was also nagged by a feeling of educational incompleteness owing to my lack of 
a second language, of knowledge of any non-EuroAmerican history and culture, and 
of direct experience living outside the United States. Finally, being shouldered with over 
$30,000 debt in the form of college loans, I saw a future of economic insecurity—as a 
joke at the time had it, “I have a liberal arts degree...will that be for here or to go?” 

Lo and behold, I stumbled across a solution to all these nagging misgivings in the 
unlikely form of an army veteran who told me of the possibility of becoming a linguist 
in military intelligence. If I passed the linguistic aptitude test and the security back- 
ground check, I could be sent to full-time language school in Monterey, California, then 
stationed in Europe or Asia, have my student loans paid off by the army, and have the 
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direct experience of the most academically demonized institution in the United States. 
I would be able to climb into the belly of the beast only theoretically known by my 
professors and fellow-student ideologues. That experience would round out my formal 
education with an existential reality-check. (The prospect of experiencing military life 
itself was to me, with my romantic infatuation with Homeric epic, not unappealing at 
all. I saw it as an opportunity to compare the modern military ethos with that of Homer’s 
Heroic Age. It was an anthropological opportunity to experience a foreign culture we 
call the military.) My academic friends and most of my professors thought I was either 
crazy or immoral or both, but I trusted the Clinton administration not to compromise 
my morality—and anyway, I reasoned, in a worst-case scenario, I could always disobey 
orders. I only hoped it wouldn’t come to that. 

Three months later I had finished basic training (aka “Boot Camp”) and my shaven- 
headed self was beginning his 64-week, full-time study of Modern Standard Arabic. My 
instructors were all native Arabs from diverse Arab nations, and they all had stories to 
tell. They also were walking cultural artifacts themselves, representing the civilization 
that produced them. Overall I found them intensely likeable and fascinating. 

Studying the language itself was a labor of love. Arabic is a largely pure language, 
uncorrupted by loan-words and structures from other language families. Consequently, 
the language is itself an artifact of its ancient origins in the Bedouin tribes of the Arabian 
interior. The desert environment in which the language was born is literally perceptible 
in the language itself. The Arabic word for mustache, for example, shariban, is based 
on the verb “to drink” and given the suffix representing a pair of something. In other 
words, the meaning of “two drinks” is embedded in the noun. The function of a mustache 
as a collector of water which can be sucked on when thirsty points to the presence of 
the harsh Bedouin life of nomadic travel across the parched deserts of the Rubb al-Khali, 
the “Empty Quarter,” from oasis to oasis. Other examples are to there in abundance to 
be discovered by the student of Arabic. 

The irony of this experience is that I was being taught this language implicitly as 
the language of the enemy. Yet the unintended consequence of introducing me to my 
Arabic professors and the beauties of Arabic language, history, and culture was to 
convert me into a person who greatly (yet in certain instances critically) respects, 
sympathizes with, and reveres ‘the enemy.’ 

Pedagogically this experience is relevant in many respects. Our Anglophile 
tendency to glorify the richness of the English language, while justifiable, should not 
blind us to the probable glories in other languages. Students of all cultures should have 
the opportunity to share their pride in their language with non-speakers of it, and to 
learn about other languages from those who speak them. On a more humanitarian level, 
the most important thing we as educators can do today is counter any national 
propaganda that tries to dehumanize ‘enemy’ nations with direct encounters with people 
from those nations. The best way to convert an enemy to a fellow human being is to give 
him or her a name and a story. 
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Appendix D 
Captions Reflecting on Understanding Others 


Cl-40+ a8 


—— 


When Even Batman is Homeless 


How more disconnected could a student feel than when studying 18" and 19” century liberalism? What does the freedom of John 

| Stuart Mill and Joseph Chamberlain mean to a 15-year-old student at an international school in Caracaras, Venezuela? Plus cc 

| change, plus c'est la meme chose. My students live in a city with a surging violent crime rate and spiraling poverty. Political 
marchers are often confronted with violence, and the government frequently commandeers private TV and radio stations. It seems, 

| the country could use a superhero. But, where is Batman? Perkins emphasizes that education cannot function in a bubble, but rather 

| that “education is a function and force of the world at large. Students become engaged in topics or units because a central theme in 

| such education is the making of connections with students’ own lives” (Perkins, 1993). This photo was taken by one of my 
students. I took them to the streets to let them evaluate the conditions of liberty in Caracas and construct their own understanding 
Much to my surprise many students had never been to a very common shopping area. My students were shocked by the world they 
lived around, but not necessarily in. Although reluctant to confront strangers at first, soon they were talking with soldiers, 

shoppers, shoe shines and, yes, even the homeless, about the conditions of liberty in the city where they live | 


Perkins, D. (1993). Teaching for understanding. American Educator: The Professional 
Journal of the American Federation of Teachers, 17(3), 8, 28-35 


From Robert Kuhl, High School Teacher, Caracas, Venezuela 


Appendix E 


Home Culture. School Culture. Whose Culture? 


Consider: Enculturation is the process of learning one’s own culture, influenced by home 
and family. Acculturation is the process of learning aspects of a culture other than one’s 
own, influenced by schools and society. How does the relationship between the school 
culture and home culture impact learners? It is critical to maximizing educational 
effectiveness for those involved in the educational process to recognize the culture(s) 
of their classrooms, programs, and institution, and how these may conflict with the 
traditional or home culture or learners participating in that acculturative process. 

Attend an activity that introduces you to a different ethnic group with which you 
are not already familiar. Select an activity in which YOU will be the minority. Your event 
must have the approval of your instructor. Based on observations and questions, 
determine the culture for a specific learner. Select a learner who is significantly different 
from you. Responses should reflect the perspective of the interviewee, NOT the 
assumptions of the interviewer. 

Review a resource from the school in which you are observing. Ideally, select a text 
that is used by all members in the class. Complete a curriculum resource evaluation 
regarding all items pertinent to the item under review. Provide specific examples 
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documented by page numbers, frequency counts, and/or passage documentation. If a 
question is not applicable (NA), provide an explanation telling why. Credit will not be 
given for single-word responses. 

Observe an educational setting—-the site at which you are observing in this Core. 
Describe the setting with specific attention to the questions regarding the school 
environment. Again, documentation matters. 


Reflect on all of this information and present a reflective interpretation in narrative 
accompanied by a visual/graphic, software-generated representation (e.g., concept map, 
Venn diagram, bar graph, table) that documents the analysis. 


SCHOOL CULTURE 
Curriculum Resource Evaluation 


. Bibliography (APA format) of resource. 
. Type of resource being reviewed (text, film, video, module, curriculum unit, other) 
3. Level considered most appropriate by author(s) or school district and/or developer: 
Early Childhood, Primary, Intermediate, Middle School, High School, General, or Adult. 
Is the resource current? Copyright date alone does not indicate content currency. 
. Which visibly different groups or people are depicted in this material? 
. How are various groups depicted? In what roles? Be specific as to gender and ethnicity, 
physical abilities, age, frequency of appearance, and context of appearance. 
. Does the content present contributions written and/or edited by different ethnic 
groups? Does the content present multiple perspectives? 
. How might the book affect the image of a visibly different group of people? Consider 
both macro and microcultures. 
. Does the resource include illustrations that realistically portray the events involved? 
10. Is the content material integrated (no added sections for special groups)? 


School Environment 


1. Do the bulletin boards, posters, photographs, maps, and other visible curriculum 
materials reflect ethnic diversity? If so, how? 

. Do the calendars in the school include information about ethnic minorities, women, 
and outstanding Americans of minority groups? 

. Do the foods that are served in the school cafeteria reflect ethnic diversity? If so, in 
what ways? 

. Does the classroom or school library include an ample number of books about 
American ethnic groups for all grade levels? If so, have the books been evaluated 
for their sensitivity to ethnic groups? 

. Do the school assemblies and extra-curricular activities reflect the ethnic diversity 
of American life? If so, to what extent? 

. What behaviors are rewarded? Aggressiveness? Obedience? Conformity? 
Achievement? Competition? Other behaviors? 

. What rewards or punishments are used to accomplish these behaviors? Who 
administers these? 

. What values are promoted? 

9. How are parents encouraged to participate? 


FAMILY AND HOME CULTURE 


. How many generations has the family lived in the United States? 

. What ethnic heritage does the family claim? 

. What are the social roles of each family member (financial support, childcare, . . .)? 
. What is the family structure? What members make up the structure? 

. What is the educational background of the family? What is the attitude toward 





90 


Assessing Culturally Responsible Pedagogy 


education? 

6. How is “leisure time” spent? 

7. What is the role of religion? 

8. What non-verbal communication styles are evident? 

9. What language(s) is/are spoken? 

10. What values are taught? 

11. What does the diet consist of? Eating times? Eating behaviors? 

12. How are gender roles defined? 

13. What is the attitude of family members toward the school program and faculty? 

14. How often have family members visited the school site? What type of atmosphere 
did they report finding? 

15. What, if any, chores and responsibilities are assigned to the children? 
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Impacting Teacher Candidates’ 
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Regarding Diversity: 


Faculty Triggers’ 
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The increasing diversity of students within our educational systems 
demands improved training within teacher education programs at insti- 
tutions ofhigher education (IHE). Thisis, also, evident through standards 
of state and national accrediting bodies, through professional organiza- 
tions guidance, and through demands of consumers of public education. 

Along with training, assessment of teacher candidate knowledge, 
skills and dispositions about multicultural/diversity is critical (NCATE, 
2002). It can assist institutions of higher education in making program- 
matic decisions as to diversity issues. It can, also, help provide evidence 
that the diverse needs of children, youth, and their families within our 
public school systems will be better met than in times past. 

Faculty members within teacher education programs have great 
demands placed upon them. This includes making sure courses have 
diversity issues embedded throughout them, that field experiences 
provide hands-on learning with a diverse population of students, that 
teacher candidates learn to meet individual needs along with collective 
needs, and that assessment of candidates is successfully conducted. Yet, 
how are we assuring that faculty members are provided with the training 
needed to meet these expectations? Where do the knowledge, skills and 
dispositions regarding diversity issues emanate with faculty who are 
charged with training our teacher candidates? 


Refractive Errors 


The Conceptual Framework (CF) of the College of Education at a 
Midwest university states that: 
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The unit’s CF reflects the unit’s commitment to preparing candidates to 
support learning forall students and provides a conceptual understand- 
ing of how knowledge, dispositions, and skills related to diversity are 
integrated across the curriculum, instruction, field experiences, assess- 
ments, and evaluations. 


Okay, that is all well and good; however, faculty members at this 
university may wonder how they are suppose to assure this happens in 
the program in which they work. 

One problem is that the diversity representation of faculty at IHEs 
and teachers in our public school system do not always mirror the 
diversity of the students in their classrooms/programs (Campbell-Whatley, 
2003; Dieker, Voltz, & Epanchin, 2002; Smith, 1998). So, teachers in 
school systems and faculty at IHEs “cannot count on being able to relate 
to the diversity of students in the schools simply based on their own 
backgrounds” (Miller, Strosnider, & Dooley, 2000, p. 15). Additionally, 
while the nation’s school systems’ demographics are increasing in 
student numbers of racial/ethnic, cultural, and linguistic diversity; the 
faculty numbers across these diverse areas are not increasing (Fenwick, 
2001). The problem is compounded when thought is given to where 
faculty at [HE originate. If teachers who represent diverse cultures are 
not entering teacher education programs at doctoral levels, it will be 


increasingly difficult to gain adequate representation at [HE levels. It is, 
therefore, imperative that recruitment efforts be developed that help 
bring diversity within teaching and faculty positions over the next 
generations in order to overcome these refractive errors. In the mean 
time, current faculty at IHEs (who represent more mainstream cultures) 
must be afforded the training required to meet the diverse needs of 
teacher candidates in personnel preparation programs. 


Held Accountable 


According to Miller, Strosnider, and Dooley (2000), of the teachers 
who have graduated from teacher education programs since the mid 
1990s, most have been required to take at least one course that addressed 
multicultural diversity. If this translates as a separate course, not 
embedded as core content within/across all courses or assessments 
throughout their program, it may set up dispositions of separatism 
without this being the intension. Hidalgo, Chavez-Chavez, and Ramage 
(2002) suggest that teacher educators promote a curriculum infusion 
approach to diversity training rather than a one-course serves all model. 

The early course(s) on multicultural issues, typically, translated only 
to content about children of African or Latino heritage in urban or inner 
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city settings (Miller, Strosnider, & Dooley, 2000). More recently, require- 
ments have moved beyond this to issues of multicultural/diversity (which 
encompasses a broader range of learners to include race, ethnicity, 
physical or mental condition, gender, age, geographic region, sexual 
orientation, religion, language/linguistic, marital status, socioeconomic 
status, or other elements within the definition) (Gibson & Follo, 1998; 
Miller, Strosnider, & Dooley; NCATE, 2002). With this expanded defini- 
tion comes increased requirements of faculty. Yet for faculty that were 
educated prior to diversity being embedded in their preparation pro- 
grams, they may not have the knowledge, skills or dispositions to 
adequately prepare teacher candidates within their personnel prepara- 
tion programs. For these faculty members, training may be limited to 
what they sought or were provided in terms of continued professional 
development. So how have faculty members acquired the skills needed to 
train teacher candidates to meet the needs of the diverse students who 
will be in their classrooms? What triggers have faculty encountered to 
produce change in their own practice (whether in teaching, scholarship, 
or service requirements)? 


From Rhizomes to Research 


The Multicultural/Diversity Outcomes Assessment Project (MC/D) 


team members (from a participating university located in the Midwest) 
met often to discuss its plan for the assessment of its candidates within 
the teacher education programs regarding issues of multicultural/diver- 
sity. Discussions ensued about what measurement tools to use, how to 
distribute them, ifthe assessment instruments could be embedded within 
courses, or if they could be placed on-line. The work at hand was exciting, 
and setting aside time to work with valued and knowledgeable colleagues 
brought energy tothe project. Yet, just as arhizome sends out roots below 
to produce new stems and leaves elsewhere, the faculty team began to 
reach out, discussing broader interests regarding diversity issues within 
the College of Education. One area of conversation included how the 
faculty members, who train our candidates, were informed about diver- 
sity issues, and whether they could or should be included in the 
assessments of diversity. Talk of whether assessing faculty would be 
threatening in any way ensued. It was known that some studies had 
minimal response to assessment of faculty on diversity issues in the past 
(e.g., Gibson & Follo, 1998; Miller, Strosnider, & Dooley, 2000). Like all 
researchers, however, questions began to shoot up as to how information 
could be gleaned from faculty to produce answers without feeling 
threatened. Informally, project team members began to ask each other 
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what affected their practice regarding diversity. Shortly, thereafter, a 
research question emerged and approval was sought from the IHE’s 
Office of Research Administration to add the research as a part of the 
assessment conducted within the MC/D project. 


The Research Question 


In order to meet the needs of a busy faculty, information about the 
MC/D project and the following research question was sent out to all 
faculty members within the College of Education via email: “What 
‘triggers’ can you identify regarding your knowledge, skills, and/or 
dispositions about diversity that affected/changed your practice (whether 
teaching, research or service).” Triggers were more fully defined in the 
email request so potential participants knew this translated to what 
training, interactions, or experiences impacted them enough to change 
their practices. 


The Research Participants 


The response from faculty was slow in coming, so the question was 
distributed again via the email system. As faculty members were met in 
passing, reminders and encouragement were provided to respond to the 
request. Following the multiple requests, a total of 17 participants (out 


of a possible 75, which is a 23% return rate) produced data to be analyzed. 
Participants included faculty from the departments of Curriculum and 
Instruction, Educational Leadership, and Communication Disorders and 
Sciences within the College of Education. Diversity among participants 
included faculty who were Americans with Asian heritage (first genera- 
tion immigrant), European heritage (majority of respondents), Russian 
heritage (first generation immigrant), and one who is Australian. 


Data Obtained 


The participants in this study generated data in three ways. First, most 
of the participants provided a reply to the email request/research ques- 
tions. Some, after giving what they wrote more serious consideration, 
followed up by sending additional email responses, furthering their reply. 
Others, when met in passing, shared their experiences in person. During 
these encounters, the researcher immediately located paper/pencil and 
recorded these responses in the form of field notes. Others, met in passing, 
stated they did get the email request, but chose not to reply (these 
individuals were not asked why, so reasons remain unknown). 

Second, syllabi from 2001 through 2004 used by the participants 
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responding to the email or in-person request were evaluated to deter- 
mine what, if any, information could be gleaned that demonstrated what 
and how multicultural diversity content/performance was embedded in 
teacher education courses and how it changed over time. Finally, a follow- 
up email request was distributed to all of the faculty in the College of 
Education within the participating university. The email request was 
intended so participants could provide additional information regarding 
their perceived needs for continued professional development in the area 
of multicultural diversity. 


Gathering and Analyzing the Data 


Triggers. In order to better understand the subjective experiences, 
perspectives, and views of faculty participants of what triggered their 
change in practice regarding diversity, answers were analyzed using a 
constant comparative method of qualitative analysis (Maykut & Morehouse, 
1994) to arrive at categories and codes across participants from their email 
and in-person interviews. Three broad areas of categorizing the data 
emerged for reporting purposes: (a) specific codes for what triggered 
change; (b) the change, if any, that was produced due to the triggers, and 
(c) the number of participants who mentioned the coded trigger‘(s). 

Syllabi. Following the email and in-person interviews, syllabi were 
reviewed to obtain whether the participants (the 17 participants who 
responded to the trigger request) were embedding content regarding 
multicultural diversity within their courses taught in the Teacher 
Education program at the university. Data was compared across the 
academic years of 2001 through 2004 to note (a) whether or not 
multicultural information was included within the syllabus/course, and 
(b) whether or not changes in syllabi/courses regarding multicultural 
diversity were noted across the target years. 

Perceived Professional Development Needs. Finally, email and hard 
copy survey responses from faculty in the College of Education were 
analyzed to look for patterns of need for continued professional develop- 
ment in the area of multicultural diversity. Note that only one request 
was made by email with a follow-up hard copy survey request distributed 
at a faculty meeting. Further follow-up reminders, thereafter, were not 
distributed. 


Reporting the Results 


Trigger Data. Final participants (n =17) were quite articulate in how 
they gained the knowledge, skills and dispositions about issues of 
diversity that impacted what was embedded into their practices. Follow- 
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ing analysis of the narrative data (email/interview), ten coded categories 
emerged to explain what triggered (i.e., affected/impacted) changes 
across their responsibilities (e.g., teaching, scholarship and service). 
Those categories consisted of (a) professional bodies that set standards/ 
guidelines for diversity in professional training within educational pro- 
grams; (b) lived experiences, including those from across their childhood 
through adulthood; (c) reading of research/literature; (d) involvement 
from specific grant/other projects that included issues of diversity; (e) 
interactions and/or friendships from others who influenced or inspired 
them; (f) information gained from reviewing evaluation/assessment 
instruments; (g) threats of legal action/grievances; (h) videos; (i) attend- 
ing conferences; and (j) a final category emerged regarding emphasis 
from participants wanting to make sure that the researcher knew their 
definition of diversity went beyond just color. Appendix A summarizes the 
codes, changes and number of participants within each code. 

The category that emerged as the one most discussed by participants 
was their lived experiences. These examples included those from childhood 
through adulthood, including personal encounters within their courses. 
One participant told of an experience in class that triggered change: 


As I taught the Introduction to the Exceptional Learner course, we were 
discussing whether we thought there were biases built into the identi- 
fication process of special education. A lively conversation began with 
candidates talking about how tests were old, so didn’t contain informa- 
tion relevant to today’s society. Others talked about how tests were 
normed. One student, an American girl with African heritage, stated 
that she remembered a time in grade school where she would walk the 
halls past one room that she thought was the classroom where all Black 
males were sent. She found out later it was the special education room. 
This remark stopped the conversations cold. From that experience, I 
immediately began a search of the literature for determining biases 
within special education testing. I included this information thereafter 
in every course I taught. 


Another participant, along these same lines, remarked: 


I remember visiting a middle school in USD 259 with a very diverse 
population of students. When we passed the classroom where students 
with gifts and talents were in attendance, diversity in that class was 
clearly missing. The population of students did not match the population 
in other classes. 


Others talked of professional experiences prior to coming to a position at 
an IHE: 


Having loved teaching in Detroit, I asked to teach in a low-income school 
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where about 25% of the students were minority, both Black and Native 
American. I then took a position as a teacher corps team leader in a 
minority-teaching grant. We had 6 team leaders (I was the minority 
white person) and 40 interns (4 white). My real enculturation began here. 
I studied minority students. I worked with minority peers and candi- 
dates. I worked in minority schools. I attended and taught minority 
studies workshops. I would goto a restaurant with one of the Black team 
leaders whose husband was a vice chancellor at KU. Never did they 
approach her to ask her to follow them to be seated, they always 
approached me. Never did they ask her first what she wanted to eat, they 
always asked me first. Politely with a grin I would say ‘please ask her 
first.’ attended dinners, ate things I had never eaten (chitlins and greens 
are not my favorite, but with Tobasco, I went back for seconds). 


Some participants talked of personal experiences within community 
events that impacted a change in attitudes: 


Iremember atime when I went toa Cinco de Mayo celebration held within 
a Hispanic community. I couldn’t wait to eat some of the food being served 
out of individual booths. I had my three small children with me, in order 
for them to experience a cultural celebration different from their own. We 
appeared to be one of very few White faces in the crowd. We were enjoying 
the music when we decided we were hungry. I finally found the booth that 
served authentic tamales—my favorite. We waited quite a while in line, 
finally making our way to the front of the line. I turned in our order for 
tamales only to be told they were all out of food—so sorry. I was so 
disappointed, but thanked them and turned to leave. While walking 
away, I turned to encourage one of my children to hurry and catch up, only 
to see that the individuals in line after us (Hispanic heritage) were being 
served the food. My first reaction was of extreme anger—how could they 
have done this—it was discrimination. Then, within seconds, I thought— 
oh, I get it; now I can begin to understand the angry feelings of many of 
them in similar situations. From that moment, my attitude changed. 


Other categories included how participants sought out knowledge from 
reading relevant literature, from choosing specific sessions on diversity at 
professional conferences, and from professional organizations. 


Your question is a good one but also a difficult one to answer. I started 
integrating issues of diversity into my teaching and research quite a few 
years ago. I’m hoping Iremember correctly! I suppose the “triggers” were 
two. First, ASHA has been promoting the importance of cultural and 
linguistic diversity (CLD) for quite a few years. A person in higher ed 
would be hard pressed not to know of the importance of infusing the 
curriculum with diversity or being aware of having a diverse population 
when studying specific aspect of language and literacy research. Second, 
just being in child/adolescent language and literacy, it is difficult not to 
understand the effect that CLD has on language and literacy acquisition. 
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As far as how my teaching and research has changed, I guess there are 
two more answers. First, I integrate literature and lecture much more 
on the effects of CLD on language and literacy development. Second, I try 
to ensure I have a range of CLD in the participants in my studies. 


From the 17 participants, 10 made sure that the researcher understood 
first that they have been influenced in areas of diversity beyond that of 
race/ethnicity only. 


In both Masters programs, we have teachers from large school districts 
(urban) and people from small school districts (suburban and rural). 
This has made me reexamine the various strategies that I present in 
methods classes as most of my teaching experience is in urban settings. 
I seek examples of major topics from students in suburban and rural 
settings to add to the course content—so application is more easily 
pictured by students. 


This same respondent provided additional information for this category 
by stating “Poverty is another diversity issue with the teachers in my 
classes and how they can ‘deal’ with it so that students learn.” One 
participant who is Australian provided the following: 


More recent and more subtle influences on my current behavior and 
attitude have resulted from my own experience as “not so mucha stranger 
in a foreign land.” The fact that I look like many of my colleagues in this 
institution has de-emphasized that my heritage and background experi- 
ence are different. In this culture there seems to be an unspoken belief that 
race or ethnicity doesn’t really count unless one’s skin is a dramatically 
different color or unless one belongs to one of a small number of officially 
recognized minorities. Reflection on the situations that result from this 
disparity is instructive personally and professionally. 


A few participants talked of gaining additional knowledge and skills 
from grant projects in which they were involved: 


When I think of the way my treatment of diversity issues has evolved in 
the past two years, three triggers come to mind. The first was the 
IMPACT Project. Though I have always included issues of special 
education in my elementary methods courses (science methods and 
integrated mathematics-science methods), my knowledge of those is- 
sues was largely based in experience as a classroom teacher, and my 
formal knowledge was somewhat superficial. The IMPACT Project 
helped to deepen my knowledge and consider some new possibilities. The 
way that this new knowledge was enacted in my classroom was greatly 
influenced by the second trigger: team teaching for a semester with one 
of our special education faculty who also has expertise in mathematics. 
As a result of her modeling, I’ve become much more insistent that my 
students take their responsibilities seriously during field experiences. 
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Finally, ve been increasingly influenced by the situations that I see as I 
supervise my students in their field experiences. Many of them are placed 
in schools and classrooms with significant numbers of children with 
limited English proficiency, and it has become abundantly clear that they 
must be prepared to reach this population as well. What we find, ofcourse, 
is that many of the strategies that are most successful in reaching special 
needs populations are also very successful in meeting the needs of the 
general population. With thoughtful planning, the adjustments in instruc- 
tion and assessment often turn out to be quite minor. 


Reading and listening to what affected and changed participant’s 
knowledge, skills and disabilities about issues of diversity, again, pro- 
duced a rhizome effect. As more and more participants mentioned that it 
was their “lived experiences” (largest coded category) that impacted a 
change, additional questions began to emerge for future research efforts. 
For example, if this is true of faculty, would it, also, be true of our current 
candidates. Do preservice and graduate level professional programs need 
to make sure that candidates have increased and more diverse experi- 
ences within their programs? Do programs need to rethink what those 
experiences consist of, rather than just assuming that placements in 
diverse schools alone will meet requirements and produce educators with 
the required knowledge, skills and dispositions? 

Syllabi Review. Syllabi from faculty participants were examined 
between the academic years of 2001 through 2004. Specific content was 
searched for information about multicultural diversity within the course 
title, course description, major topics, candidate/student outcomes, and 
assessments. One immediate, notable difference was that syllabi for the 
years of 2001, 2002, and 2003 had various formats of preparation by the 
faculty members teaching the courses. By 2004, however, all faculty 
members used a common template that aligned the major topics and 
candidate learning outcomes with the College of Education’s (COE) 
Conceptual Framework (which includes the guiding principle of human 
development and diversity), the NCATE standard on diversity (NCATE, 
2002), and state standards (which for some included standards with 
indicators requiring content of multicultural diversity). Additionally, 
syllabi were all noted to increase the content for multicultural diversity 
between the years reviewed. Examples of changes in selected syllabi 
(three of the 17 faculty participants, representing courses at the early 
childhood, elementary and secondary levels) regarding inclusion of 
content about multicultural diversity across the years of 2001 through 
2004 are found in Appendix B. 

Knowing that the university underwent NCATE accreditation review 
in the fall of 2004, the use of a common syllabus template that aligned 
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content with the COE Conceptual Framework and the standards became 
a trigger for change for all faculty members in the teacher education 
programs. Additionally, as faculty prepared for the NCATE review during 
the fall of 2004, the diversity standard (NCATE, 2002) became a topic of 
discussion that contributed to faculty focusing on how their syllabi 
reflected what was taught in the course (faculty participant emails and 
interviews). 

Perceived Needs for Continued Professional Development. As a final, 
culminating act of this research, faculty participants were provided with 
both an email and follow-up survey request (handed out at a faculty 
meeting) asking what they perceived as further professional development 
needs in the area of multicultural diversity. Faculty responses (n=12) were 
analyzed for distinct categories. The needs included: (a) need for additional 
resource support such as attending trainings at conferences and/or 
workshops on diversity/multicultural education, and additional videos or 
other materials that could be viewed in courses regarding issues of 
multicultural diversity; (b) additional training on recruiting and retaining 
of candidates/students who are from diverse backgrounds, (c) additional 
training on how to work with candidates/students who are from diverse 
backgrounds in order to provide the support needed to be successful in their 
programs, and (d) additional training on the culture of poverty to make sure 
this diversity is included in our courses and field experiences. 


Research Limitations 


This information is intended as only a beginning to understanding 
how faculty members within IHEs gain their own knowledge, skills and 
dispositions regarding multicultural/diversity. The participants were 
limited in numbers and to only one university teacher education pro- 
gram. Additionally, faculty were not observed regarding whether or not 
what was said in their emails or interviews or what was reflected in their 
course syllabi was actually taught/included within their courses/practice. 
Therefore, there are limitations to this current study. In order to fully 
understand the issues, the what, when, why, and how of ways faculty gain 
the information embedded in their programs, and how it “triggers” 
change in their practices, additional research needs to be conducted. 


Conclusion 


The field of education is uniquely poised to make real differences for 
our future. Through quality educational programs, students will learn to 
live and work together in an increasingly diverse global society. By 
providing strong adult models, including teachers and other educators, 
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that mirror the children’s and youth’s culture, by sharing dispositions that 
all children belong and are valued members of our society, and by meeting 
individual needs at higher levels, all of our futures will be brighter. 

First steps toward meeting this goal is to increase not only the 
knowledge, skills, and dispositions of teacher candidates/students, but to, 
also, increase it for the faculty who train them. Inquiring about the 
current strengths and needs of faculty regarding multicultural education 
can be a beginning. Providing resources, whether sending faculty to 
conferences/workshops or conducting in-house training, can be an asset. 
Existing literature can be obtained for faculty that provides strategies for 
multicultural education of teachers (e.g., Smith, 1998; Vavrus, 2002). 

Secondly, in order to meet the diverse needs of students and their 
families within our school systems, greater effort must be placed in 
recruiting and retaining diverse teacher candidates and the faculty who 
teach them. Research has been conducted regarding effective strategies 
for recruitment of diverse teacher candidates and faculty (Patton, 
Williams, Floyd, & Cobb, 2003), yet much remains to be done in order to 
catch up with our increasingly diverse society. 

Bowers and Apffel-Marglin (2005) suggest that teachers (both faculty 
at institutions of higher education and within public school systems) 
should be provided “with an in-depth understanding of these aspects of 
culture, with an emphasis on differences between modern and traditional 
cultures” (p. 174). Additionally, they suggest that issues regarding 
various cultures should be taught to students in other college/university 
departments and not just those housed in teacher education programs, 
yet this is not usually the case. If professors in other departments 
included “tradition, technology and other topics” (p. 175) indigenous in 
diverse cultures within their courses, this could assist in raising aware- 
ness across society, including school-based systems, without it always 
falling just to the shoulders of teachers. 

Even though teacher preparation programs at IHE may not be where 
education on diversity begins, or where it should begin, for candidates/ 
future educators, but it can certainly affect changes thereafter. Teacher 
education programs can make diversity the core of its pedagogy, content 
knowledge, field/community experiences, and assessments so that future 
educators can better meet the diverse needs of students within their 
chassrooms/programs. Faculty can, also, connect and collaborate with 
other departments across campus to assist in embedding diversity content 
into other courses. Assessing candidate knowledge, skills and dispositions 
regarding diversity can provide vaiuable information for individual and/or 
program improvement. In order to begin this process, however, efforts 
must be placed on educating the trainers of these future teachers. 
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This study gives only a beginning insight into what triggers faculty at 
institutions of higher education to fit diversity into their practices, 
whether teaching, research or service. It cannot be assumed that all 
faculty, whether long-term veterans or newly hired doctoral program 
graduates, have extensive preparation in the area of diversity, or that 
what is embedded in their practice comes only through their formal 
training. Ongoing recruitment and retention of a diverse faculty, profes- 
sional develop and personal experiences in the area of multicultural 
diversity, in its broadest sense (e.g., beyond race and inclusive of the 
culture of poverty), through a variety of venues, and additional resources 
must be provided in order for real change to occur. 


Notes 


1This paper was presented at the 2" National Conference on Assessment of 
Multicultural/Diversity Outcomes, April 3, 2004, Kansas City, Missouri. 
? Note that not all participants provided how their triggers changed their practice. 
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Appendix A 
Trigger Data 





Category/Code Changes Suggested | Number 

for Triggers Due to Triggers! of Respondents 
Who Mentioned 
This Trigger 
Professional @ Used as guides to embed 4 

Bodies Who Set into courses/syllabi 
Standards/ @ Used as guides to better 
Guidelines document what is currently 
(NCATE, done regarding diversity 
ASHA, CEC) within courses 

@ Used as knowledge-base 4 
for many areas of “diversity” 
Total Respondents 
to this Trigger 
Code = 4/17 

Lived @ Increased/changed dispositions 
Experiences regarding biases, inequities in self | 
(Childhood @ Used in class lecture 
experiences 2/10; @ Use in class discussions 

As teachers in @ Used in research, as examples 
programs 5/10; @ Used to guide interactions 
Via students with students 

comments or @ Prompted additional learning 
behaviors in (read books, took classes, 
courses/class 6/10; | attended conferences) Total Respondents 
In a leadership | to this Trigger 
role 1/10; Code = 14/17 
Observations 
within educational 
settings during 
students supervised 
visits 5/10) 


| 
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: 
Category/Code 
for Triggers 


"T Cees Suggested 


Due to Triggers! 


Number 

of Respondents 
Who Mentioned 
This Trigger 





4 


Research/Literature 
(Seek out written 
forms of knowledge) 


(IMPACT grant, 
SpEd focus), 
MC/D grant 
(inclusive 
diversity focus) 





@ Used information, 
embed in areas of 
teaching and research 


5/17 





Specific Projects @ Increased information 


for class lecture 

@ Changed dispositions (to 
become more inclusive) 

@ No response to change 


1 


Total Respondents 
to this Trigger 
Code = 3/17 





Individuals Who 
Have Influenced 
or Inspired 
(Interactions and 
relationships 
developed between 
faculty and another 
who had a different 
cultural background) 


@ Changed dispositions 
@ Use information in course work 


4 
3 


Total Respondents 
to this Trigger 
Code = 4/17 





Beyond “Color” 


as a Definition 





Lack of valid and 
reliable assessment 
instruments 


@ Faculty who described triggers 
beyond just as described by race/ 
color (including exceptionality, 
SES level, geographic location, 
gender, international views, 
sexual orientation) 





@ Seeking additional knowledge/ 
skills on how to modify assessments 
so they are appropriate (not biased) 
for students with special needs 





Threat of legal 
action or grievance 
being filed 


Watching Videos 


Attended 
Conferences 





@ No change mentioned 





@ No change mentioned 





@ Included information in courses 
@ No change mentioned 





1 
i 


Total Respondents 
to this Trigger 
Code = 2/17 








2001 2002 


MC/D Content: 


Major Topics: 
(only place 
that included 
diversity): 


“DAP 
Curriculum— 
multicultural” 


“Integrated 
Curriculum- 
socially 
understanding 
self and others” 
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Appendix B 


Syllabi and Multicultural Content Changes over Time for Three Courses 


Course—Instructional Strategies 


Preschool Education 


MC/D Content: 


Major Topics: 
Same as 2001, 
plus added in 
special education 


Assessments: 
Comprehensive 
Written Unit — 
added in to 
remember the 
different ages, 
stages, families, 
and cultures 

of the children. 





2003 
MC/D Content: 


Major Topics: 
Same as 2001 
and 2002 


Assessments: 
Multicultural 
Story Outline and 
Lesson Plan 
(choose a book 
from another 
culture than your 
own and make an 
outline that can 
be tied into a 
lesson plan) 


Graduate Project 


was added to create | 


a DAP activity 


| related to the 


multicultural 
lesson plan 





2004 
MC/D Content: 


[Aligned with COE Conceptual 
Framework: Human 
Development and 
Diversity; NCATE 
Standard 4; and 

State Licensure Standards.] 


Major Topics: 
remained the same as 2003 


Assessment: 
Same as 2003 


Outcomes: 

Added included: 
“Incorporate concepts 
and materials from many 
cultures in planning 
learning environments 
for young children;” 
and“Demonstrate respect 
for differences in family 
values and describe 
strategies for working in 
partnership with families 
to encourage young 


children’s development.” 
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Course—Instructional Strategies in Math and Science 


Elementary School 











2001 
MC/D Content: 


Major Topics: 
“Teaching 
mathematics 
and science to 
ALL students — 
diversity” 


Student 
Outcomes: 
“Plan, teach & 
display a 
knowledge of 
diversity issues” 


2001 
MC/D Content: 


Major Topics: 
“Gender and 
ethnic equity 
issues in science” 


Outcomes: 
“Demonstrate 
an awareness 
of and a way 
of addressing 
gender equity 
while teaching 
science.” 


[2002 


MC/D Content: 
Same as 2001 


Textbooks- 
Readings 
included the 
National Math 
and Science 
Standards, 
which calls for 
issues of 
diversity 





+. 





2003 
MC/D Content: 


Same as 2002, 
except added: 


Guided Inquiry 


| Section — “4. 


How will 


| multiple 
| diverse 


perspectives 


| enhance the 


teaching of 
mathematics 
and science in 
your classroom?” 





2004 


| MC/D Content: 


{Aligned with COE 
Conceptual Framework: 
Human Development and 
Diversity; NCATE 
Standard 4; and State 
Licensure Standards.] 


Same as 2003, plus added 
in Assessments: 


| Added in Teacher Work 


Sample, which includes 


| requirements of identifying | 


special cultures within the 
school placement and how 
individual needs, based on 
culture, would be met. 


Course—Instructional Strategies 


2002 
4 
MC/D Content: 


Same as 2001 








Secondary 


| 2003 


MC/D Content: 


| Major Topics: 


“No child left 


| behind, meeting 


needs of all 
students” 
“Gender and 
ethnicity equity 
issues in science” 


Outcomes: 
“Identify 
strategies 

for reaching every 


| student in the 


classroom. 
Describe the 
students and the 
strategies which 
meet their needs.” 
“Demonstrate an 
awareness of and 
a way of addressing 
gender equity while 


teaching science” 





2004 


MC/D Content: 

[Aligned with COE 
Conceptual Framework: 
Human Development and 
Diversity; NCATE 
Standard 4; and State 
Licensure Standards.] 


Major Topics and 
Outcomes were the 
same, except added to 
Outcomes and linked to 
COE Conceptual 
Framework:“The 

teacher understands the 
abilities and developmental 
readiness of students to 
learn science content and 
skills” and “The teacher 
understands the 
psychological and social 
environment conducive 
to the students’ 
intellectual, social, 

and personal growth in 
science education” 
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Introduction 


Although the teacher education profession’s recent attention to 
multicultural education is to be lauded, research needs to be conducted 
to attempt to define what constitutes an effective program. This discourse 
has become increasingly more important given the rapidly changing 
demographics of the United States. The decade of 1990-2000 witnessed a 
57% increase in the United States foreign-born population ... The US 
Census Bureau (2000) predicts that people of color will make up 38% of 
the nation’s population by 2025 and 47% by 2050. Schools are increasingly 
culturally diverse and, according to Gollnick and Chinn (2004), more than 
one third of the school population today is comprised of children of color 
while the teaching force is “86.5% white and 75% female” (p. 4). While the 
demographics of the undergraduate population in this study are similar 
to those cited by Gollnick and Chinn, the graduate population is much 
more racially diverse and includes more males. 

This research is based on the premise that teachers need to be effective 
in creating teaching~learning experiences for ALL students (Huber, 2002) 
and that all teacher candidates can become more effective in developing 
knowledge, skills, and dispositions to do so. Regardless of the background 
of the school professional or the backgrounds of the students, all teachers 
need to be effective in teaching all students successfully. 

Both of the commonly used terms in discussion here, multiculturalism 
and core curricula, are highly contested in education today according to 
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Fitzgerald and Lauter (1995). The perspective taken in this analysis is 
that common multicultural experiences in core programs provide sources 
of bonding, discussion, and shared work for students. According to 
Ladson-Billings (1995), one of the cutting edge trends in multicultural 
teacher education is the examination of classroom practices of successful 
teachers in diverse classrooms. 


Awareness, Knowledge, and Skill Levels 
about and Working with Diverse Populations 


Neville, Heppner, Louie, Thompson, Brooks, and Baker (1996) found 
that a one-semester, multicultural issues in therapy course appears to be 
related to white individuals’ adoptions of more positive, non-racist, White 
identities. This and other related studies lend support and encourage- 
ment for professionals who may need to obtain more training in the 
multicultural area to best meet the needs of their current and future 
students and serve their ever-diversifying clientele more competently. 

Ridley, Mendoza, and Kanitz (1994) noted “the evaluation of 
multicultural counseling training is critical ifthe goal of providing quality 
services to all clients is to be effectively met” (p. 274). The focus on 
evaluation of training effectiveness and the acquisition of multicultural 
therapy competencies has become increasingly more important to our 
changing society as noted by Neville et al. (1996). With increased 
exposure to multicultural issues will awareness, knowledge, and skill 
levels about and working with diverse populations result? According to 
Sue (1991) and D’Andrea, Daniels, and Heck (1991), some researchers 
outlined training models while others focused on the evaluation of 
training effectiveness. Specifically, in this inquiry, primary focus was on 
whether courses result in awareness, knowledge, and skills for profes- 
sionals to deal with the diversification of the student populations? 

One attempt to assist teachers in understanding and working more 
successfully with diverse populations is the enactment of requirements 
regarding multicultural/diversity education for prospective educators 
and other professionals working in an educational setting (e.g., adminis- 
trators, principals, counselors, nurses) and for teachers seeking recerti- 
fication. A goal of multicultural education cited by Cochran-Smith (2004) 
“is to improve race relations and to help all students acquire the 
knowledge, attitudes, and skills needed to participate in cross-cultural 
interactions and in personal, social, and civic action that will help make 
our nation more democratic and just” (pp. vii-viii). According to Evans, 
Torrey, and Newton (1997), 25 of the 50 states, plus the District of 
Columbia, in the United States have criteria and requirements for 
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multicultural education. While this criteria is not consistent across all 
certification programs, the respondents all mandated some type of course 
work in multicultural education for teacher certification as found by 
Evans, Torrey, and Newton. Relative to the total amount of literature on 
multicultural issues, little attention has been directed toward developing 
consistently sound and conceptually anchored programs and instrumen- 
tation for assessing or evaluating the numerous variables involved in 
these teacher education programs. 

This research is based on the premise that attitudes, knowledge, and 
skills can be assessed and a purpose of assessment should serve as a tool 
to improve teacher preparation. 


There are many purposes and forms of assessment. However, there 
should be just one motivation: assessment should serve as a tool to 
enhance all students’ knowledge, skills, and understanding so that they 
can function at the highest possible level in the wider world. In theory, 
then, educational assessment could be well aligned with the broad aims 
of multicultural education: to enable students from all circumstances to 
use their minds to the fullest, to explore social and cultural phenomena 
from diverse perspectives, to participate thoughtfully in a democratic 
society, and to apply their knowledge and skills in ways that can improve 
the human condition. (Kornhaber, 2004, p. 91) 


This empowerment of the learner applies to teacher candidates and 
teachers seeking advance degrees as much as it applies to students in 
classrooms P-12. One of the interesting demographic considerations is 
the age of the participants in the graduate classes and their wealth of prior 
experience upon which to draw. 

Grant, Elsbree, and Fondrie (2004) conducted a review of multicultural 
education research from 1990-2001 and found only a few exemplary 
studies including intersections of social constructs. More research needs 
to be conducted to assess the impact of courses and other program 
features on the candidates’ awareness, knowledge, and skills in dealing 
with diversifying populations. Erickson (1986) clearly indicates that 
researchers in the field of multicultural education need to conduct 
research to assess findings in similar and dissimilar settings over time. 

This study is an attempt to assess the multicultural awareness, 
knowledge, and skill levels of candidates in teacher preparation programs 
and to compare data across undergraduate and graduate level courses 
taught by different instructors to see if any significant differences or 
similarities occur. The graduate students in this study are enrolled ina 
nontraditional teacher preparation program and differ from the typical 
populations described by Gollnick and Chinn (2004). Nontraditional 
programs are defined as those other than the typical undergraduate 
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program whereby courses meet evenings and weekends culminating in 
student teaching. In this case, the graduate program is a licensure 
program that can lead to a master’s degree. 

The basis for this study is grounded in current literature from the 
fields of education, counseling, and related multicultural studies, exam- 
ining multicultural awareness, knowledge, skills, and dispositions. Gen- 
eral curriculum theorists and multiculturalists typically have not used 
the same conceptual paradigms, methodologies, and variables of analysis 
in developing their scholarship according to Gay (1995) and Smith (1998). 
Cochran-Smith (2004) found that continued use of theories and practices 
developed primarily by white teachers and scholars created the image 
and presented the message of these being the best and that they were race 
neutral. While these messages may have been subtle, they continually 
reinforce past practice rather than examine education as socially and 
culturally constructed—anything but race neutral. 


Procedures 


A research packet consisting of the MAKSS-T and a personal data 
sheet were distributed to all students who were enrolled in the courses. 
Participation was anonymous and strictly voluntary and there was 
neither a reward for participation nor a penalty for lack of participation; 
however, some students were encouraged to consider the importance of 
this data to the teaching profession. Graduate response was higher than 
undergraduate, with a 97.2% (n = 70) graduate response rate. 

The instrument was to be completed during the first week of classes, 
at the mid point of each course and during the last week of classes. All 
surveys were to be placed in manila envelopes and returned for tabula- 
tion. The courses were still in progress as this manuscript was being 
reviewed for publication 

The larger study sought to evaluate the effectiveness of course work 
dealing specifically with multicultural competencies by using both quali- 
tative and quantitative measures. In order to assess possible change, the 
use of an instrument, The Multicultural Counseling Awareness, Knowl- 
edge, and Skills Survey, which has been found to be reliable and valid in 
articles by D’Andrea, Daniels, and Heck (1991) was used. This instrument 
consists of a 60-item survey divided into three subscales, which are 
equally divided to provide measures of multicultural awareness, 
multicultural knowledge, and multicultural skills. 

Participants used a 4-point Likert-type scales ranging from 1 (very 
limited) to 4 (very good) or 1 (strongly agree) to 4 (strongly disagree) to 
describe themselves. Subscale scores, after summing and dividing by 20, 
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ranged from 1-4 with higher scores representing more in-depth aware- 
ness of personal attitudes toward racial and ethnic minorities in the 
United States, knowledge about racial and ethnic minorities in the 
United States, or familiarity in skills to better deal effectively with racial 
and ethnic minorities in the United States. The subscale have been found 
to have acceptable estimates of internal consistence (alpha coefficients): 
Awareness = 0.75, Knowledge = 0.90, and Skills = 0.96 D’Andrea et al 
(1991). To assess the MAKSS criterion validity D’Andrea et al (1991) 
performed a Mann-Whitney U test and results suggest that there was no 
significant difference between the experimental and control groups 
before taking a multicultural counseling course. 

While this is designed more specifically for counseling, some minor 
modifications were made to assess the same competencies with prospec- 
tive teachers. A word change from counselor to teacher is an example of 
such a change. For purposes of this study, the revised instrument was 
then designated as The Multicultural Awareness-Knowledge-Skills Sur- 
vey for Teachers (MAKSS-T). (Sample questions from the 60-item survey 
are provided in the Appendix.) 


Participants 


In the first round of data collection conducted by Warring, Keim, and 
Rau (1998), the researchers found consistency with the approach and 
style used in the teaching of courses in Counseling Psychology and 
Education even though the course content, books, and other materials 
used were different (Rau, Keim, & Warring, 2001). The current round of 
data collection is also examining the responses from candidates enrolled 
in courses not specifically designated as Human Relations or Multicultural 
Education. 

The participants from the original study entered the courses thinking 
they already had the awareness, knowledge, and skill and found out that 
they did not as measured by the MAKSS-T. Their scores showed 
significant improvement by the end of the courses. 

One would expect a large drop in scores if the questionnaire were 
administered at the midpoint and that there would be a slight increase in 
scores from the midpoint to the end of the course. The current study will 
assess the scores from the first week of classes, midpoint, and last week 
of classes in each course for any changes. 

In the current population, all participants are candidates for licen- 
sure enrolled in courses required in their respective programs of study. 
The courses include three sections of a graduate course in Human 
Relations/Multicultural Education, three sections of a course in under- 
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graduate Human Relations/Multicultural Education, and one section of 
a graduate course in Social Foundations of Education. All participants 
were students enrolled in a private, predominantly white, university 
located in a metropolitan area in the mid-west. 

The participants were asked to voluntarily list their sex, age, race, 
and ethnic/cultural background as well as some other descriptors each of 
the 3 times they filled out the survey. They were asked for self- 
identification of race and also of ethnic/cultural background rather than 
providing the more typical boxes to be checked. The results were then 
tabulated and compiled. 

Participants were all students (n = 112) who were enrolled in seven 
separate sections of different required courses in their respective core 
programs leading to licensure. Of that number, 70 were female and 42 
were male. When separated by program, there were 45 undergraduate 
students and 67 graduate students. Of the undergraduate students, 34 
were female and 11 male. Table 1 provides an overview of these data. The 
age of the undergraduates is the typical 19-21 year old while the graduate 
students range in age from 22-52. Many of the graduate students were 
returning to seek licensure to work in schools and had already been in or 
currently were in other careers. The participants in the current study at 
the graduate level self-described as 53.73% (n = 36) female and 46.27% 
male (n = 31), with 85.7% self reporting their ethnic group as European 
American or some sub category and 14.3% self reporting their ethnic 
group as one of anumber of combinations of African or African American, 


Table l 


Demographic Data—Sex 


Female Male Total 


Undergraduate 34 / 75.5% 11/ 24.5% 45 / 100% 
Graduate 36 /62.5% | 31/ 37.5% 67 / 100% 
Total n/% 70 / 62.5% 42 / 37.5% 112 / 100% 














Table 2 
Demographic Data—Ethnic/Cultural Background 





African or | American | Asian or Hispanic | European 
African Indian* Asian or American* 
American* American* | Latino* 





Total 
n/% | 5 /4.4% 2/1.67% 7/6.25% 8/ 7.14% 90 / 80.4% 





(*Note—this is a compilation of all sub categories into the larger groupings) 
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Asian or Asian American, American Indian, or Hispanic or one of a 
number of combinations of sub categories (see Table 2). 

All three sections of the graduate course in Human Relations/ 
Multicultural Education had the same instructor who was a White male 
professor with a doctorate in educational and social psychology. Two of 
the sections of the undergraduate course in Human Relations/Multicultural 
Education had a Native American female associate professor who earned 
a doctorate in children’s literature, while the other undergraduate 
section had the white male who was teaching the graduate sections. One 
section of a graduate course in educational foundations had a white 
female professor with a doctorate in curriculum and instruction. All three 
instructors had taught this or a similar course for ten or more years. 

The courses in Human Relations/Multicultural Education are specifi- 
cally designed to deal with topics concerning diversity while the Social 
Foundations of Education course is covering related topics, with sub- 
topics identified concerning diversity. One of the questions to consider at 
a later date will be whether the responses of the respective candidates 
differ in any significant manner due to the course title and content. 

All faculty members in this study utilized materials by a variety of 
writers and researchers from many different backgrounds to include 
multiple perspectives and assist learners in developing critical perspec- 
tives. This approach resonates with Cochran-Smith’s (2004) contention: 


Two themes that were not about literacy and literature per se but were 
intended to be fundamental to these courses and the entire program were 
(a) understanding teaching as an intellectual and political activity and the 
teacher as constructor of knowledge and curriculum; and (b) developing 
critical perspectives about race, class, culture, and schooling. (p. 95) 


The participants were asked to list their ethnic/cultural background 
and a blank line was provided on the questionnaire. No categories, 
descriptors, or other information was provided. The responses were 
consolidated into the overall categories used in the tabulation of data (see 
Table 3). Of the 112 participants, 80.4% listed European American or 
some subcategory as their self-report for ethnic/cultural background, 
4.4% listed African or African American, 6.25% listed Asian or Asian 
American, and 1.67% listed American Indian. 


Course Format 


All courses were required as core courses and while six of the courses 
were devoted strictly to multicultural issues, the seventh infused 
multicultural issues into an educational foundations course. Core pro- 
grams are those that require all students who plan to graduate to 
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successfully complete those courses that are specified as requirements. 
Although there were differences in teaching styles between the three 
instructors, the courses contained several similarities. Three groups were 
undergraduate students and four groups were graduate students. Two 
sections of the undergraduate course met twice each week for 100-minute 
sessions and one of the undergraduate and all but one of the graduate 
courses met once a week for 150 minutes. The other graduate course met 
300 minutes per week for 7 weeks. All other courses met for 15 weeks. 

Three of the graduate sections and one of the undergraduate sections 
were assigned readings by authors from a variety of cultural backgrounds 
and given assignments to analyze their own culture and one other culture 
and make specific applications to the classroom. They were also given 
specific criteria and assigned the task of conducting an interview with a 
person who self-defines as a member ofa specific cultural group (different 
than their own). All assignments were designed to increase and assess 
awareness, knowledge, skills, and make applications of multicultural 
concepts. Concurrently with one section of a graduate class the students 
were involved in a 30-hour clinical assignment in the schools. 

On a weekly basis throughout each of the courses participants in 
three groups were assigned selected readings and asked to respond in 
writing toa series of questions designed to assess awareness, knowledge, 
skills, and application of multicultural concepts. A qualitative assessment 
was also conducted. 


Analysis 


The demographic data from the current participants differ substan- 
tially from the participants in the first round of data collection a decade 
earlier when 87.3% (Keim, Warring, & Rau, 2001) were European Ameri- 
can, as well as differ from the current description provided by Gollnick and 
Chinn (2004): “the race and sex of their teachers match neither the student 
population nor the general population; 86.5% of the teachers are white and 
75% are female” (p. 4). With more than one-third of the school population 
today comprised of children of color there is a need for the teaching force 
to be more representative of both society and the student population. The 
graduate student population appears to be a move in that direction. 

Another area for consideration is religious diversity that raises a 
number of challenges for educators according to Gollnick and Chinn 
(2004, p. 5). In the graduate population of participants in this study, three 
of the respondents identified as Muslim, from two different continents 
(Africa and India); one as Jewish; and one, Hindu from India. Again, the 
graduate population in this study clearly counters the current projection. 
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Prior to analyzing the data, the various classes will be examined for 
significant differences on their pre-test scores. In a previous study by 
Warring, Keim, and Rau (1998) no significant differences were found. The 
researchers expect different findings with this population due to age, 
religious, gender, and other demographic differences. 

Three t-tests will be utilized to compare the pre-and post-test scores 
on the MAKSS-T (awareness, knowledge, and skills). Finally, three 
ANOVAs will compare the pre-and post-test scores by gender to deter- 
mine any significant gender differences. 

Qualitative analysis will consist of examining comments from the 
students’ coursework and final course evaluations. The procedure is for the 
students to fill out a final course evaluation after the instructor exits the 
room upon completion of the last class meeting. The evaluations are then 
collected by a student in the class and given to the department secretary 
who tabulates the results. The results and the evaluations are returned to 
the course instructors 8-10 weeks after the grades are submitted. This 
procedure provides student anonymity to allow for honest responses 
without concern for any penalty or benefit by an instructor. 

Analysis of data in the larger study will include pre, mid, and post tests 
with all groups. Calculation of Cronbach’s alpha coefficients, Pearson’s r 
coefficient, Wilcoxin Rank Sum Test ofnonparametric Techniques, Analy- 
sis of Variance, and Multivariate Analysis of Variance (MANOVA) will be 
conducted. Since the study was not completed at the time of submission for 
publication, the quantitative results have not been conducted. 

The revised MAKSS-T was examined for reliability and validity. 
Additionally, the classes will be examined for significant differences prior 
to collapsing them for this research. It is predicted based on anecdotal 
data that most students enter the course thinking they already know all 
they need to about multicultural education. The course is designed to 
challenge these assumptions and present them with current information. 

The current design of multicultural education is more ideological and 
methodologically central to the entire educational enterprise and not a 
separate curriculum or program. Through this design different ways to 
analyze and interpret and reinterpret are utilized. According to Gay (1995) 
these processes are self-reflection, critical interrogation, knowledge 
deconstruction, knowledge reconstruction, meta-cognition, and develop- 
ment of multiple perspectives rather than a one best way approach. Gay 
(1995) states this creates a self-renewing and regenerative process. 

The qualitative results of this study are consistent with the approach 
and style used in the teaching of these courses. The participants enter the 
courses thinking they have the awareness, knowledge, and skill and find 
out that they do not. One would expect a large drop in scores if the 
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questionnaire were administered at the midpoint and that there would be 
a slight increase in scores from the midpoint to the end of the course as 
their knowledge and skills increased. 


Discussion 


As one of the few empirical investigations of multicultural training, 
the larger research study has a number of implications. This study 
demonstrates the potential impact of instruction on multicultural com- 
petencies through self reported changes over a period of time. Linda 
Darling-Hammond (1998) argues that teacher knowledge and expertise 
are significant factors that influence student learning. It follows from this 
premise that outcomes must be monitored and policies enacted that 
impact outcomes. 

Neville et al. (1996) found that courses focusing on multicultural 
issues are related to participants who self identify as Whites, adopting 
more positive, non-racist, White identities. The results of this study and 
other related studies provide support and encouragement for profession- 
als who may need to obtain more training in the multicultural area to best 
meet the needs of their current and future students and serve their ever- 
diversifying clientele more competently. 

Ongoing research needs to be conducted in classrooms to assess the 
design and implementation of effective models as well as the demographics 
of the students entering professional teaching programs. Preliminary 
demographic analysis in this study contrasts completely the image of 
teacher candidates depicted in the professional literature, which indicates 
that the demographics of the current teacher candidates closely mirrors 
those of the current teacher population. Ongoing demographic analysis 
and research need to be conducted to see if the shift in gender and ethnic/ 
cultural background of those entering the teaching profession is shifting 
and will be acontinuing trend orifthis group of participants is an anomaly. 
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Appendix 
Sample Questions from the MAKSS-T 


A. Questions for which the response options are Strongly Disagree, Disagree, Agree, 
or Strongly Agree 

@ How would you react to the following statement? While teaching enshrines the 
concepts of freedom, rational thought, tolerance of new ideas, and equality, it has 
frequently become a form of oppression to subjugate large groups of people. 

@ The human service professions, especially teaching and related fields, have failed to 
meet the mental health needs of ethnic minorities. 

@ Ambiguity and stress often result from multicultural situations because people are 
not sure what to expect from each other. 

@ The effectiveness and legitimacy of the teaching profession would be enhanced if 
teachers consciously supported universal definitions of normality. 

@ The criteria of self-awareness, self-fulfillment, and self-discovery are important 
measures in most teaching sessions. 

@ Even in multicultural teaching situations, basic implicit concepts, such as fairness and 
health, are not difficult to understand. 

@ Promoting a student’s sense of psychological independence is usually a safe goal to 
strive for in most teaching situations. 

@ While a person’s natural support system (i.e., family, friends, etc.) plays an important 
role during a period of personal crisis, formal teaching services tend to result in more 
constructive outcomes. 

@ Educational problems vary with the culture of the student. 

@ Teachers need to change not just the content of what they think, but also the way 
they handle this content if they are to accurately account for the complexity in 
human behavior. 


B. Questions for which the response options are Very Limited, Limited, Fairly Aware, 
or Very Aware 


@ At the present time, how would you generally rate yourself in terms of being able to 
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accurately compare your own cultural perspective with that of a person from 
another culture? 

@ How well do you think you could distinguish intentional from accidental communi- 
cation signals in a multicultural teaching situation? 

@ In general, how would you rate your level of awareness regarding different cultural 
institutions and systems? 

@ How would you rate your understanding of the concept of “relativity” in terms of goals, 
objectives, and methods of teaching culturally different students? 
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